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ABSTRACT 

This analysis compares the efforts devoted to 
research and development (R6D) in education with those devoted to RSD 
in health and agriculture. Specifically, it characterizes the size 
and institutional arrangement of the educational RSD community and 
compares it on a common basis with the agricultural and medical RSD 
communities. The analysis is structured around performance in 
man-years of effort by institutional setting and sponsorship in 
dollars by institutional setting. The results indicate that# as 
compared with agriculture and health, research and development in 
education has the following characteristics: a) it has a much smaller 
proportion of the total value of production; b) it is sponsored 
almost entirely by the federal government; c) it is performed in much 
greater proportion at universities; and d) it is not performed by 
federal agencies. The report does not argue for more educational RSD 
but for a determination of the structural similarities and 
differences which exist in the agriculture, education, and health RSD 
systems as a preliminary to the ultimate objective of knowing how to 
improve systems for conducting RSD. (Included are appendixes of 
related charts and tables and a bibliography.) (Author/JA) 
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PREFACE 

This Working Note was written as part of the National Institute of 
Education planning effort conducted by The Rand Corporation for the Com- 
missioner of Education. The NIE initiative stems from a belief that 
many of the problems in education today are a result of inadequate R&D 
in the past. It has been said that the system for conducting R&D is 
too small, too poorly distributed, and lacking in skills. In his mes- 
sage to Congress announcing the NIE legislation, the President mentioned 
how little has been spent on education R&D compared to other sectors of 
the economy. 

While there is agreement on the need for improvements in education 
R&D, there is much less agreement on specifications for a set of R&D 
institutions which would achieve this improvement. Little work has been 
done which describes how to build capacity for conducting and using edu- 
cation R&D. We do not know what institutions should be doing how much 
R&D, nor do we know where they should be located. It seems plausible 
that simply granting project money to individual investigators will not 
produce the results in practice that hopes have raised. Simple forms 
like university research coupled with information abstracting services 
will not be enough. Mechanisms for linking R&D with practice will be 
crucial. In its early years NIE will be faced with some hard choices. 

More knowledge on how to build better systems for conducting R&D 
would help, but such knowledge has proved difficult to find. Economists 
and others have nibbled at the edge of the problem for years. One means 
of attack on the knowledge deficit is to isolate natural experiments 
which yield insights into better ways of conducting R&D. This study 
is a step in that direction. It compares three R&D systems — agriculture, 
education, and health — with respect to the amount of R&D activity spon- 
sored and performed by various institutional settings. The next steps, 
which this study does not take, are to expand the search to other sec- 
tors, and to correlate the descriptions obtained with measures of ef- 
fect. Success is not guaranteed, and it will most certainly be difficult. 
One favorable factor will be the large differences which exist among R&D 
systems. 
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SUMMARY AND CONCLUSIONS 

This analysis compares the affcrt devoted to R&D in education with 
that devoted to R&D in health and agriculture. It shows that in terms 
of both abL^olute level of R&D effort and R&D effort as a percentage of 
sector contribution to GNP, education is considerably less well supported 
than health or agriculture. 

The comparatively low level of educational R&D may be seen by exam- 
ining four different pictures for agriculture, education, and health for 
FY 1968. These pictures are: 

(1) The man-years of research, development, and innovation activity 
perfomed in each of the possible institutional settings, 

(2) The dollars of research and development performed in each of 
the institutional settings, 

(3) The dollars of research, development, and innovation sponsored 
by each of the institutional sources, and 

(4) The contribution of gross national product in each sector. 

The picture of educatioual R&D performance by man-^years is also shown for 
fiscal year 1965 to indicate the impact that the Elementary and Secondary 
Education Act of 1965 has had on educational R&D. 

Specifically, it can be concluded that in FY 1968 (see Table 1): 

(1) The contribution to gross national product was roughly the same 
in agriculture, education, and health, 

(2) No more than one-fourth as many dollars were spent on research 
in education as in health or agriculture, and 

(3) No more than one-fifth as many dollars were spent on develop- 
ment in education as in health or agriculture. 

As Table 2 shows, the ratio of development to research sponsorship 
is higher in education (.85) than in health (.66), but lower than in 
agriculture (1.09) or the economy as a whole (1.74)'. The emphasis on 
development in education is a recent phenomenon, however; since before 
the passage of ESEA in 1965, the ratio of development to research ex- 
penditures was much lower. 
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Table 1 

R&D ACTIVITY IN AGRICULTURE. EDUCATION. AND HEALTH 



SECTOR 


SECTOR NATIONAL 
PRODUCT, Ti 1968 
(in billions) 


DOLLARS OF SPONSORSHIP 
(in millions) 


Res . 


Dev. 


Inno . 


Total 


Agriculture 


$ 73.5 


$ 380 


$410 


$240 


$1030 


Education 


$ 53.0 


$ 90 


$ 80 


$ 70 


$ 240 


Health 


$ 51.5 


$1-^00 


$1000 


* 


$2400 



* No activity devoted to innovation was included. 



Table 2 

RATIO OF DEVELOPMENT SPONSORSHIP TO RESEARCH SPONSORSHIP, FY 1968 





Research 
Expenditure 
(in millions) 


Development 
Expenditure 
(in millions) 


Development 
Research 


Education 


$ 90. 


$ 80. 


.85 


Health 


$ 1,400. 


$ 1,000. 


.66 


Agriculture 


$ 380. 


$ 410. 


1.09 


All Sectors 


$ 10,000. 


$ 17,400. 


1.74 
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The comparison of R&D funds by sponsoring institution (see Table 3) 
shows that educational R&D is very different from other R&D activities 
in that government supplies 88 percent of the educational R&D funds; 
while in the health field, government supplies 67 percent of the R&D 
funds; and in the field of agriculture, 42 percent. For all fields, 
57 percent of the R&D funds is supplied by government. 



Table 3 

SOURCES OF R&D FUNDS, FY 1968 
(millions of dollars) 



SECTOR 


FED, GOVT. 
SPONSORED 


STATE 
& LOCAL 


ALL 
OTHER 


FED. AS % 
OF TOTAL 


GOVT. AS % 
OF TOTAL 


Education 


$ 150 


$ 2 


$ 20 


87 


88 


Health 


$ 1,530 


$ 70 


$ 800 


64 


67. 


Agriculture 


$ 210 


$ 120 


$ 460 


27 


42 


All Sectors 


$ 15,000 


$ 500 


$11,900 


55 


57 



A comparison of R&D oammunities by performing institutions pro- 
duces equally striking differences. Education is unlike health, agri- 
culture, and the economy as a whole in that neither the Federal govern- 
ment nor industry performs much of the R&D in the sector (see Table 4). 
In all other sectors, at least 13 percent of the R&D dollars are con- 
sumed by the federal government, and at least 29 percent by industry. 
Another difference is that in education 60 percent of the R&D dollars 
is spent at colleges and universities, while in health the figure is 
36 percent, in agriculture 28 percent, and in the economy as a whole 
12 percent. 
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Table 4 

EXPENDITURE OF R&D FUNDS BY PERFORMER. FY 1968 



SECTOR 


UNIVERSITIES 
& COLLEGES 


FEDERAL GOVT. 


INDUSTRY 


ALL OTHER 


TOTAL 


Education** 
Health 
Agriculture 
All Sectors 


$ 110 (60%) 
$ 874 (36%) 
$ 173 (22%) 
$3,400 (12%) 


$ 2 (1%) 
$ 362 (15%) 
$ 159 (20%) 
$3,600 (13%) 


$ 10 (4%) 
$ 695 (29%) 
$ 460 (58%j 
$ 19,250 (70%; 


$ 70 (35%) 
$ 465 (19%) 
$ ~ (0%) 
$ 1,100 (4%) 


$ 190 
$ 2,396 
$ ^ 792 
$27,350 



* Totals do not add exactly as a result of round-off 
approxima tions . 

** Some innovation expenditures are included in the education 
category ($17.0 million), mostly in the university setting. 



Table 5 shows performance of RDStI by institutions in man-years of 
effort. Note that while 15,000 man-years of effort are devoted directly 
to innovation activities in agrioulturej only 1,300 man-years of such 
activity are applied in education. No separately identifiable innovation 
was included in health* 
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I. INTRODUCTION 

OBJECTIVES OF THIS STUDY 

The objective of this study is to characterize the size and insti- 
tutional arrangement of the educational R&D community, and to compare 
it on a common basis with the agricultural and medical R&D communities. 
In brief, the results are that — as compared with agriculture and health — 
research and development in education is: 

o far less a proportion of the total value of production, 

o sponsored almost entirely by the Federal government, 

o performed in much greater proportion at universities, and 

o not perfomed by Federal agencies. 

The data also show that the agriculture, education , and health sectors 
are similar in that a substantially smaller proportion of the total R&D 
expenditure is spent on development than in the nation's R&D effort as 
a whole. 

The purpose here is not to argue for more educational R&D, or for 
more R&D at the local level, etc., for differences in distribution of 
effort among R&D systems is not intrinsically undesirable. The purpose 
is to determine the structural similarities and differences which exist 
in the agriculture, education, and health R&D systems as a preliminary 
to the ultimate objective of knowing how to design improved systems for 
conducting R&D. The next step towards this ultimate objective is to 
correlate the similarities and differences detected here with the rec- 
ord of success and failure in the same systems, and then draw conclu- 
sions. Undoubtedly, more studies of similarities and differences in 
more sectors anfl in more detail than here will also be required. 

The struc\:ural differences among the R&D systems treated in this 
study are very large in some respects, raising the prospects that much 
can be learned from intra- and intersectoral comparisons of R&D sys- 
tems. Furthermore, very little study of this type has been undertaken 
in the past. Most R&D systems have grown in piecemeal fashion through 
response to a myriad of internal pressures, but have rarely been sub- 
jected to systemwide evaluations. Overcoming this shortsightedness 
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seems to offer substantial prospect for learning how to design better 
systems for conducting R&D. 

In addition to comparing research and development activity, this 
study compares effort made_to stimulate the adoption of R&D results. 
Looking at research and development alone would be a partial view, for 
broad scale utilization of R&D results Is not solely a consequence of 
R&D success, but depends also on the systems which link R&D with prac- 
tice. Except In Industry and agriculture, however, very little empha- 
sis has been placed on building linkages between R&D and practice. 

Linking R&D with practice can Involve a complex of activities. 
Among those which have been used are demonstrations, disseminations, 
and retraining programs. The entire complex of activities has been 
described by terms like: diffusion of knowledge j implementation^ and 
utilization of knotdledge^ but each of these carried a one-way connota- 
tion that seems to limit the scope of activities involved in linkl*ig 
R&D with practice. Instead, this study will employ the term innovation^ 
because it has been defined as the "act of introducing something new 
'as the driving force in practical economic advance.'" Often innova- 
tion is taken to include research and development as constituent ac- 
tivities, but here its meaning is restricted to the introduction of 
new products into use and not to the creation of these new products. 
For the three activities as a whole, the acronym RD&I will be used. 

STRUCTURE OF THIS STUDY 

Some dimensions of our agricultural, educational, and health R&D 
systems will be established by describing RD&I activity in agriculture, 
health, and education from two points of view. 

(1) PevfoTmanoe in man-years of effort, by institutional setting; 
and, 

(2) Sponsorship in dollars by institutional setting. 

A distinction is made between performers and sponsors because the set 

^Webster's New Intexmational Dictionary j G. & C. Merrlam Co., 
Publishers, Springfield, Mass., 1966. 

ERLC 
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of performing institutions in each sector is different from the set of 
sponsoring institutions. Performance is described in man-years of ef- 
fort instead of dollars to provide a basis for comparison which is in- 
dependent of salary differentials and equipment expenditures. Sponsorship 
is quoted in dollars to provide a complementary measure. Another reason 
for working with man-years on the performance side and dollars on the 
sponsorship side is that independent sources of data for manpower on 
the sponsorship side are available for educational R&D. When sepa- 
rately analyzed, they provide a check on the accuracy of the education 
data. Both the sponsors' view and the performers' view are subdivided 
by research, development, and innovation since each contributes differ- 
ently to the RD&I process. 

The education performers data are presented for two time periods, 
FY 1965 and FY 1968, to show the differential effect of expenditures 
for RD&I under Title III, IV, and V of the Elementary and Secondary 
Education Act (ESEA) of April 1965. It will be shown that these titles 
made possible a 50 percent increase in the man-years of educational R&D 
performed in 1968 over 1965. 

The RD&I activity included in this study encompasses all endeavors 
formally organized to achieve increases in productivity; whether this 
involves acquiring new knowledge (research) , creating new products or 
management systems (development), or diffusing these results into prac- 
tice (innovation) . The distinction "f oirmally organized" is important 
because it eliminates unsystematic and unplanned improvements such as 
suggestion-box developments contributed by on-the-job employees, or 
action grant programs devoid of experimental controls or design. 

TREATMENT OF UNCERTAINTY 

There are two sources of uncertainty in the results to be presented. 
There is, first, the imprecise nature of manpower and expenditure data. 
This uncertainty derives from the ambiguities which unavoidably occur 
in assigning activities to research categories, no matter how precisely 
they are defined. Whether an activity is research, development, or nei- 
ther, is often uncertain. Similarly, the distinction between agriculture- 
related, education-related, and health-related research can be unclear. 
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The second source of uncertainty Is that data are not available in the 
same format acroaa aeotora, necessitating transformation of some data to 
another format. The constants of transformation were not always avail- 
able in the complete detail desired, making it necessary to construct 
approximate transformations from the pieces of information that were 
available. 

A new method of quantitatively describing these unceL'tainties was 
derived and used throughout the report. The method is an application 
of the "subjective interpretation" of probability theory j and provides 
a means for displaying the precision which underlies the estimates of 
RD&I activity. A derivation of this method appears in Appendix A. 

Of the three sectors — agriculture, education, and health — the data 
for agriculture s.va the most precise because they were obtained from a 
management information system specifically designed to collect these 
data. The data for education performance are the least precise because 
they were obtained from a partial survey of the educational R&D commun- 
ity and rescaled to account for uncovered populations. In each sector 
the data on industry are less certain than the data for government and 
universities, since industry has not been as carefully linked into gov- 
ernment information agencies. 

Without exception, the total R&D effort reported for an institu- 
tion is a more certain figure than the research or development figure 
for that institution since source data often did not distinguish level 
of effort by research activity. In such cases, transformations were 
derived from auxiliary data sources to divide the aggregates into RD&I 
activity components. 

The uncertainties just discussed are distinct from errors intro- 
duced by omitting entire segments of activity. In the research and 
development classes of activity, the data utilized are thought to in- 
clude all segments of activity, even though some uncertainty remains 
in tallying activity within a segment. In the innovation cl£iss, how- 
ever, only some of the segments which serve an innovation function 
have been included. < 



AGENDA OF THIS REPORT 

Section II specifies the criteria for inclusion of an activity 
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in the various categories defined earlier in this section. Section III 
presents and compares the results for the performers* side. Section IV 
provides the same treatment for the sponsors' side. The value of pro- 
duction in each sector and national totals of R&D sponsorship in all 
sectors together are also presented in Section IV. Section V contains 
coiamentary on some of the study's results. 
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II, DEFINITION OF RESEARCH ACTIVITIES. SPONSORS, AND PERFORMERS 

RANGE OF ACTIVITIES INCLUDED IN EACH SECTOR 

The agriaulture eeotor is defined as all production activities 
which consist of harvesting or transforming a plant , animal » or fish 
crop."^ This includes timber and forest products manufacture, crop grow- 
ing, t-.extile weaving, tobacco, and farm animals. R&D activity is In- 
cluded in the agriculture sector if it is supported by an institution 
or industry producing in the agriculture sector, or is supported by an 
institution clearly devoted to agricultural objectives. Agricultural 
R&D includes knowledge-building and development activities directed to- 
ward conserving and developing the use of soil, water, and related re- 
sources; protecting man, plants, and animals from loss, damage, or dis- 
comfort caused by natural hazards; increasing the efficiency of products 
and markets and ifirprcving their quality; developing new products and pro- 
cesses; and improving the level of human nutrition. 

The education eeotor is defined to include preschool, elementary, 
secondary, and higher education services. Also included are services 
provided by private sector firms such as: secretarial schools, elec- 
tronics institutes, language schools, and in-service training to em- 
2 

plcyees. As in agriculture, R&D activity is included as part of the 
education sector if it is supported by an institution producing educa- 
tional service, or is supported by an institution which is clearly and 
primarily devoted to the objectives of the education sector. 

The health eeotor is defined to include production of pharmaceu- 
ticals, ophthalmatic and orthopaedic products, physician, dental, and 

psychiatric services, public and privately controlled clinical services, 

3 

and the provision of health insurance. As in the two previous sectors, 
activity is included as health R&D if it is supported by an industry 
or institution producing health services, or by an institution 

"^Standard Industrial Classification Codes (SIC), 01, 07, 08, 09, 
20, 21, 22, 24, and 26. 

^SIC code 82. 
3 

SIC code 80. 
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clearly devoted to health objectives. Thus, research on human nutri- 
tion is counted as agriculture R&D if supported by the U.S. Department 
of Agriculture but as health R&D if supported by the National Institutes 
of Health. 

The health and education sectors are similar in that consumption 
occurs at the point of production and thus distribution cannot be sepa- 
rated from production in measuring the scale of activity. The situa- 
tion is different in agriculture where production and consumption are 
usually separated by an extensive distribution system. In specifying 
the scale of activity in the agricultural sector, accounting will stop 
at the point where production ends and distribution begins. 

DEFINITION OF RESEARCH ACTIVITY CLASSES 

Precise definitions of research and development have been attempted 
by many authors, but in using them to sort project activity, some am- 
biguity always remains. The principal difficulty lies in finding a 
criterion for distinguishing between research and development, for the 
line between innovation and R&D is relatively easy to draw. 

The innovation class of activity includes all actions expressly 
undertaken to link R&D activity with practice. Innovation includes 
informing target communities about existing R&D solutions and programs, 
demonstrating the effectiveness of solutions and programs, and train- 
ing target communities in their use. It also includes the relay of 
concerns and difficulties back to researchers and developers and the 
servicing and nurturing of installed solutions and programs. Thus, 
an activity will be labeled "innovation" if the following criterion 
is satisfied. 

Criterion for Innovation * Any activity whose purpose is to 
encourage utilization of R&D results by practitioners; and/or 
to relay problems and deficiencies back to the R&D community. 

Development is the creative process of inventing new products, 
systems, or procedures which practitioners can use to improve produc- 
tivity or fill a perceived need. Developmental activity typically 
begins with determination of design objectives, and then proceeds in 
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a disciplined way through iterative stages of aynthcsisj construction, 
and testing until a satisfactory result is obtained. Adjustment of 
the objectives during development may occur, but the final results 
will essentially match the original specification. As a final stage » 
the developed product is subjected tc a thorough trial and evaluation 
in its intended environment. Developmental activity can be viewed as 
including three subcategories: (1) operational developmentj which is 
the Invention of procedures or systems for solving operating problems; 
(2) product developmentj which is the creation of material products 
for use, and (3) testing and evaluation^ which is the verification that 
a proposed solution or invention works as intended. 

As much as any characteristic, development is typified by (1) its 
orientation towards inventing something which meets a practical need, 
and (2) the prudency of field-evaluating the final product. Thus an 
activity will be called "development" if the following criterion is 
satisfied. 

Criterion for Development . Any activity whose purpose is (1) 
inventing a product, system, or procedure which practitioners 
can use to improve performance, or (2) performing a field- 
evaluation of a developed product, system, or procedure. 

In general, research is the process of discovering explanations 
for observed phenomena through identification of the critical variables 
and the relationships among them. A variety of methods are used in 
doing research, among them are experimentation , which is controlled 
. testing of theories or proposed solutions; naturalistic observation > 
which is intuitive, exploratory analysis; and deductive reasoning , 
which is fabrication of axiomatic premises and their logical results. 
Problems are selected in research more on the basis of solubility 
than satisfaction of practical needs. Research output is evaluated 
and consumed largely by the research community itself, unlike the 
products of development which are consumed by practitipners . 

Two subcategories of research are hasia and 7nieeion''Oriented re- 
eeardh. Research that is undertaken in order to answer a question 
arising from development work, or research whose results might affect 

ERLC 
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a decision in development projects is often called mission-oriented re- 
search. Research done primarily to add to the store of knowledge with- 
out regard for its practical efficacy is often called basic research. 
Basic research results may alter perceptions and lay the foundation 
for major changes, but in themselves rarely affect current decisions. 
No attempt to separate research activity into the basic and mission- 
oriented subcategories was made in this study, since the required data 
were lacking in all three sectors. 

Policy evaluation, program evaluation, and assessment evaluation 
are included in the research category of activity in this study. Pol- 
icy evaluation is the analysis of strategic alternatives for decision- 
makers. Program evaluation is the exploration, analysis, and measure- 
ment of an educational program or programs at the local, state, and 
national level. Assessment evaluation is measuring the state of af- 
fairs in some area of concern. Ideally, this evaluation activity should 
be tallied in a separate category, but the format of available data did 
not allow this distinction. 

The distinction between research and development can be clarified 
by giving some examples. The discovery that poliomyelitis i5 caused 
by a particular virus was a result of research activity, while the 
search for and validation of a polio vaccine against this known virus 
was largely development. Efforts to produce corn that is more resistant 
to a particular disease are development, but studying the mechanisms 
of action of herbicides is research. A project to determine the fac- 
tors which affect enrollment in adult education courses is research, 
while a project to devise a curriculum for an adult education course 
is development. 

While all of the data sources used in this study have used cri- 
teria for research, development, and innovation equivalent to the ones 
just given, the method of sorting project activity into these classes 
varied somewhat. In education, activity has been sorted by Clark and 
Hopkins (1969)"^ according to definitions (see Table 1) very much like 
the ones here. They examined the role of each professional contributing 
to a research project, and then assigned his work to the class in which 



See the Bibliography, p. 97. 

ERLC 



-10- 



Table 1- 

DEFINITIONS OF RESEARCH ACTIVITY MODES 



SECTOR AND MODE 



PERSONCS) SORTING ACTIVIH INTO JdODES & CRITERIA USED 



AGRICULTURE^ Performance & 
Sponsorship 

Research 



Basic research 
Mission-oriented research 



Development 



Operations development 
Product development 
Testing and Evaluation 



Innovation 



Author of this study. 

All activity formally organized to pursue the objec- 
tive of increasing knowledge, and/or improving pro- 
ductivity (RD&I activity) , but not classed as develop- 
ment or innovation. 

All RD&I activity which produces output intended, to 
improve performance in practice including extensive 
field or clinica?. evaluation of that output before 
its distribution to users. 

All RD&I activity having the purpose of encouraging 
utilization of R&D results by practitioners. 



EDUCATION^ Performanae 
Research 



Basic Research 



Mission-oriented research 

Development 

Operations development 



Product development 
Testing and Evaluation 



Innovation 



. 2 



\ EDUCATION J Sponsorship 
; Research 



Clark and Hopkins^ 1969. 

! 

"The objective of this activity is to add to what is | 
known in the social and behavioral sciences. The in- j 
vestigator may or may not see the content of his work i 
as relevant to education. I 

"Investigating educationally oriented problems. Con- 
ducting social bookkeeping." 

"Inventing solutions to operating problems." 

"Engineering packages and programs for educational use*"; 

"Concern of evaluation is development and application of 
criterion measures which can be used to assess the 
efficacy of proposed solutions and programs." 

"Informing target systems about solutions and programs. 
Demonstrating the effectiveness of solutions and pro- 
grams. Demonstrating the effectiveness of solutions and' 
programs. Training target systems in the use of solu- 
tions. Servicing and nurturing installed solutions and .* 
programs. 

USOE, 1969j and author of this study. • 

"The objective or research activities is to discover, 
reinforce, or refine knowledge. Research is carried 
out because we want to devise better conceptual models 
for describing inter-relationships among variables, or 
because we want to establish a direction and nature of 
so called 'cause and effect' interaction." 
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Table 1 (cont'd) 



SECTOR AND MODE 



PERSON(S) SORTING ACTIVITY INTO MODES & CRITERIA USED 



Development 



Innovation 



"The objective of development activities carried out in 
the field of education is to produce materials, tech- 
niques, processes, hardware, and organizational formats 
for instruction • The basis for such development is our 
knowledge about learning, motivation, instruction, and 
education. The materials and techniques developed are 
designed to accomplish certain objectives, specified in 
advance, which are conistrued to be part of the broader 
goals of instruction or education," 

Dissemination, and diffusion of educational products 
and solutions into practice. Also includes demonstra- 
tions. 



HEALTH^ Sponsorship" 
Research 



Basic research 



Mission-oriented research 



Development 



Operations research 
Product development 
Testing and Evaluation 



Employees of the sponsoring agency* 

"Systematic, intensive study directed toward fuller 
scientific knowledge or understanding of the subject 
studies." 

"Investigator is concerned primarily with gaining a 
fuller knowledge or understanding of the subject under 
study." 

"Investigator is primarily interested in a practical 
use of the knowledge or understanding for the purpose 
of meeting a recognized need*" 

"Systematic use of the knowledge and understanding 
gained from research directed toward the production of 
useful materials, devices, systems, or methods, includ- 
ing the design and development of prototypes and process- 
es." 



Sources of the criteria: 

■^Clark and Hopkins, 1969; p. 30 
2 

U.S. Office of Education, 1969: pp. 1, 3, 4. 

3 

National Science Foundation (NSF-31) , 1969; p. 95. 
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he spent the most time. In health, the National Science Foundation 
(NSF-31, 1969) asked program analysts In Industry and Che agencies to 
sort their own Institutions' research activity according to definitions 
established by NSF (see Table 1). Whether sorting was actually done 
at the Individual or the project level could not be determined. In 
agriculture, the U.S. Department of Agriculture asked the researchers 
themselves to apportion their time and dollars into each of several 
research goals laid down by USDA. The division of activity in each 
goal into the RD&I classes was subjectively estimated by the author of 
this study. 

CATEGORIES OF SPONSORING INSTITUTIONS 

Table 2 describes this study's coverage of sponsoring institutions 
in general tenns, and lists sponsors by name to the extent possible. 
The list of names is not exhaustive in each category of sponsors, since 
specific names are not available uniformly across all the categories. 
This unevennesQ is inherited from the data sources and cannot be re- 
duced except at great expense. 

The grouping of sponsoring institutions into institutional set- 
tings is largely determined by the format of data sources, but an 
attempt was made to separate profit from nonprofit sources, government 
from nongovernment, and government by level. Federal government spon- 
sors are listed individually if their mission is primarily directed 
to the sector in consideration, or sometimes in the residual category 
("Other Federal Agencies") if their mission is primarily in service 
of another sector. 

Sponsorship is measured in dollars of total expenditure for re- 
search activities including project management, sub-professional per- 
sonnel and secretarial costs, and purchase of equipment* Construction 
monies are not Included nor are management costs at the Federal level. 
Federally sponsored research in industry includes all overhead costs, 
but many overhead services such as those produced by Government Ser- 
vices Administration are not Included in sponsorship of government 
research. Whether or not overhead costs are included in industrially 
sponsored Industrial research and development was not determined* 



-13- 









O 












o 










CM 








(U 


o 


r-H 








•s 


w 








s 




o 








w 




H 



ERIC 



S 

i 
g 

CO 



i 
i 

CO 



ft; 

i 

CO 



Ml 

u| 

Ml 













cul 






(U 


1 1 










CO 




cu 














CU 




cd 


cu 




vo 




CO 










ma! 
Qui 


C3 








CU 


M 


0 






(J 




*H 


•H 




*H 


*H 


*H 








•C 






4J 


td 






Cd 


X , 
M 




*H 


cu 


0 


*H 


CU 






w 


2; 




C/) 




O4 






a. 






0 


d 




0 


d 


• 


)-l 


0 




u 


0 




a. 


•H 


CU 


a. 


•H 


CU 


a. 


CO 




a. 


CO 




td 


d 




cd 


d 


D 




cu 






cu 


rH 


rH 


u 


U r-H 


•u 






X 


dlrH 




d 


<C 


cu 


•H 


< 


CU 


•H 



0) 

1-1 
(d 

CO 
0) 

4J 
•H 

d 

cu cu 

Oi t3 
X D 

CU rH 
U 

o d 



cu 
u 
cd 

(0 

cu 
u 

D 



d 

cu cu 
Oi -a 
X 3 

cu r-l 

o 

o d 





(0 
















d 










cu 






0 




1 










CU 


ti 




ra 


rc 


u 


cd 




cd 


ta 




d 


ea 


en 


es 




CO 


CO 




•H 


es 




ci 




1-1 






)-i 


)-i 




d 




0 


d 




0 




cu 


cu 






cu 






rH 


a. 


00 






a 






Cd 


X /cd 


/ 


(0 


•H 




CO 


U 








d 


1-1 




d 


a 




cu 




0 


CU 




0 


B 




CO 




•H 
4J 


O. 




•H 
4J 


ra 


u 

•H 


he 




Cd 






Cd 




}-i 






•H 






•H 


X 


W) 








cu 


CU 




CU 


<: 






a. 


u 


t3 


a. 










0 


a 


D 


0 




cu 






'h 




H 




d 


u 


CO 


-a 


a. r-H 




a. 


cd 


cd 


d 


cu 


a. 


0 


d 


a. 


4J 


0 


-a 


cd 


0 

•H 


•H 


cd 


al 


CO 


ti 


lu 






CU 


rH 






cd 


0 


1-1 


W) 
< 




iH 


D 


-B 




c 


< 


Cd 


< 


B 


cd 


CO 







4J 














6 


• 




0 










a 




0 


00 


CO cu 


d 






CO 




cd 


cu 


u 




:3 M-l bO 




1 










u 




c 


0 C 


m 


C 






0 


iH 


a 


0 


cu 


>> Cd 


(U 


0 




>> 




(0 










vi 






c 










0 0 










0 


CU 






§ 




§ 


u 






•H 


•0 


u 


• 




(U 4J U 




0 






4J 


cu 




cu 


03 


4J Cd 


u 






u 


CO 




u 


u 


cu 


3 d c 


GQ 








iH 




60 


c 


M 


BOO 




U 








•0 


CO 


cu 


1 


•H ^ •H 




C 








c 




•H 


.c 


<U CO 4J 


• 








CO 


CO 




U 


0 


GO 4J Cd 




0 




OO 






0 


OO 


c 


CU a 


U 


U 




(U 






M-l 






CU M 


U 


u 








03 




u 




03 > 0 


CO 


cd 


• 


cn 


> 


u 


03 




0 


(U «H M-l 






03 


(U 




u 


c 


00 


M-l 


u u p 


4J 


0 








CO 


0 


CO 




a CO H 


09 


u 


c 




03 




•H 


J3 


C 


4J D 


J3 




cu 


4J 




4J 


u 




0 


•H cd <U 


CO 






CO 


CO 


CO 


•0 


•H 


c 1? c 




cu 


c 


•0 




J3 


•H 




4J 




03 


0 


C 


X 


CO 






CO 


oj cu 0) 


» 




a 


CU 


(U 




a 


Cd 


03 




H 


> 


03 


a 




u 


0 


rH 


s 


CO 


CU 


cu 






u 


CU 




.O CO 




u 


u 


u 




CO 


a 


u 


0. 



cu 
u 















> 






1 


00 






















U 






rH « 


d 








rH 










cu 




CU 






3 CO 


•H 




CO 








cu 






0 




CO 






0 0 


CO 




•H 




s 




u 






•H 


cu 








•H 


CO 








0 




•H 






> 


0 








M 60 


cu 


d 


4J 




•H 




> 


CU 






•H 


0 






&0 0 


u 


cu 


)-l 




4J 




u 


0 






> 


u 






cd M 


0 




0 




3 


(0 


cu 


•H 




CO 


u 


cd 






0 


u 




a. 




^ 


4J 


CO 


> 






cu 


cu 






d -H 


cu 


0 


a. 




•H 


a. 








00 CO 


CO 










rH 


D 




4J 


cu 




CU 




c 




cu 










CU 


CO 




CO 


Q 


rc 


CO 




ti 


ve 








iH d 


00 


> 


d 




m 


CU 


cd 


JS 




u 


•H 


<u 




cu 


d cd 






0 






1-1 


cu 


0 




0 


4J 








•H 






•H 




G 


3 


CO 


)-l 




Ou 


cd 


cd 






Cd CO 




4J 


4J 




0 


4J 


cu 


cd 


cu 


cu 


}-l 






> 




?N 


u 


Cd 




•H 


rH 




cu 


u 


Pi 


ai 


CO 


CO 


u 


Cd 


u 


D 




'U 




D 




CO 


•H 




o. 






cu 


0 


cu 




d 


CU 


Cd 


U 


cu 


cu 


> 


rH 


0 


cu 


c 


CO 




d 


0 


D 


t3 


u 


•H 


u 




u 


cd 


0 


> 


D 






•H 




0 


D 


D 




D 




cu 


u 


C-? 




pLi 


c 


cu 






iH . 


-a 






u 


CO 


•H 








0 




u 






U 


cu 




iH 






4J 


CO 


Cd 


0 


•H 


c 0 


cd 




CU 


d 




CU 


D 


1 




CO 


)-l 


'h 


00 


CO 




B 






•H 




U 




CO 


•H 




cu 




c 


C) rH 

\ : cd 


d 


cd 




Q) 


4J 


•H 


d 


cu 




g 


a. 




cu 


B 




> 


0 


J2 


cd 


)-i 


0 


u 


cd 




0 






Al u 


u 




•H 


CO 


00 


4J 




0 


0 




Cd 


0 




X 


d D 


cd 


d 




rH 


•H 


CO 


< 




(X4 


CO 


PX4 


u 


P4 




P -u* 


1^ 


cd 




Cd 





O 
• O 

u 

G 
O 

U 



03 



e 
o 



CO 

•O 03 

C cu 

o u 

Cm C 

CU 00 

o < 
G 

«H CO 

U U 

r.O <U 

iH CU 

CO U4 

c 

o u 

4-1 jd 

CO U 

^ O 



d 

i 

d 
}-i 
cu 
> 
o 



<: 

Q 
CO 



4J 

CO 
3 

•xa 



>^ CO 

•H -H 

CO O 

M c 

cu cu 
> 00 

rH 

Cd 

cu 0) 
4J 0) 

O U4 



-14- 



c 
o 
o 



CM 



§1 
CO 

SI; 



1 



CO 



<: cd c 

U U cd 

CO o ffi 

w > 

S ^ 

o <: vo 

M-l O T-H 



I 

S 

S O 



I 

C 
O 4J 



> 4J 
O 

o 

> o 

W M -H 

C 4J 

o •» td 

•HMO 

4J M 3 
Cd M 

•H W 

M CO 

O iH td 

M 4J C 

a. -H o 

a. H "H 



o 
c 

C CO 

cd M CO 

4J 4J O 

O C P 
< Q) 

CO 

(U 4J QJ 
•^3 cd 3 

r-H (U M 
•H K O 

6^5 

cd 

(U C M 

td en 
o >»vo 

•H 4J 0> 
-H r-H 



)-i CO 
O 4J 

c 

oo cd 
c u 

C 

•H 4J 

Cd c 

a. 

M cr 

cd Q) 

CO ^3 
(U c 
M cd 

(U CO 
no Q) 

r-l 4J 



c 
o 

•H 
4J 

Cd 
o 

O 

(U 

o 



o 



CO 
t3 



U 

0) M CJ 

H O Cd 

rH U-l 0) 

O 4J 

0 CO 

1 G 

(U 5 C 

M 'H cd 



CO 

0) > C 

^ Q) 

4J Q ^ 



CO d 

C ^ B 

0 CO ^ 
•H »-i • 
4J OO g CO 

Cd M P 0) 

•H (U r-H 4J 

01 d o 4J 

0 E=> v^ -H 
u u u 

01 »-i CO 
a c 3 c 



o 

•H 
4J 

td 

I 

0) 
CJ 
C 
0) 

•H 
O 

CO 



cd 

§ 

•H 
4J 



0) 








cd 




(0 




§ 








•H 








td 




•H 








a. 


• 


o 


^3 


u 


CU 


0.^3 


a. 




Cd 


rH 






o 


c 




•H 




o 



o 



O 



4J 4J 0) ^-l 

CO CO > O T3 

C C Q) C 

M M P 4J U 

c 

r-l r-H C 0) rH 

cd cd cd B cd 

c c § 4-> d 

O O P )-i o 

•H ffi cd *H 

cd cd ^ 



u 

T3 cd 

S a. 



CU 

CU CO 
4J 

cd CO 

CO d 

(U o 



CO 

d 



O 

o ja 
u 
a 

CO 



to w 

0) > 

o o 

M CO 

§ ° 

CO 

^ CO 

o cd 

iH 
4-» O 



a. d 

O 0) 

a. M 



CO 



CO 1-1 

> CO 

O fl) 

d »H 

0) d o 

a a o 

CO C 



d 

B d 

4-» O 
CO 4J 

O. CO 

«^ 

u 

CO *W 
4-» O 
CO 



(U 

Cd 
a 

(U 
4J 

cd 

•H 

a. 

o •o 

M (U 

a d 

CO iH 

o 

o d 

S5 -H 



43 

d 
o 

•o . 

CU M 
fl o 

•H d 

4J CO 
QQ 

(U 4J 



(U CO 

U (U 

d M 

u a. 

•H 

d 43 

(U 4J 



U-l 
(U 



CO 

> 



M 



ERIC 



1 
I 

Co 



O 
CO 



Pt4 

CO 



o 

o 



cd 

u 

(u CO 

PC4 (U 

•H 

o 

(u d 

43 0) 
4J ClO 

o <: 



d 

1-1 

I 

0) 

cd 

4J 
CO 



-15- 



a 
o 
o 



CM 



CO 



1 



kj kj 



5 



So 



o ^ 

CO o 

t, 

Q> GO 

§ ^ 

CO CD 

(U 



Vi 0) 

00 no 

s § 

& 

o *J 

• a 

P^ Q 



(0 42 



M 

(U 

•H O 

(U (U 
Oi 03 

M *0 



CO 

u 
I 

d 
o 
d 

o 



c 
o 



u 
cd 

CO 

d 
o 

•H 
4J 
Cd 
•H 

o* • 
o 

M 0) 
cd iH 

o 

o d 
I 









V-i 


cd 


cd 


CO 


CO 


d 


C 


o 




•H 


•H 


4J 


4J 


Cd 


Cd 










a. • 


a. • 


O 


O 






a. 


a. 






Cd rH 


cd rH 


o 


o 


o d 


o d 







D 


1 
















Cd 






1 




CU 




O 






1 


•H 




4J 


1 


d 






42 


rH 




Cd 


CU • 


•H 


or 




IE 


•H 
O 




rax 


43 M-l 
M-l 


Q 






cd 


Cd 




4J 


CO cd 








CU 


M-l 




CO 


d 4-» 


Pi 


in 




42 






CU 


O CO 
•H 




d 






o 




o 


CO » 


o 






O • 








CO H 




Cd 










Pi 


S'' 








cu 


d 








CO 


4J 




CO ^3 


H 




u 


CO 


d 






d D 


d 




o 


:3 § 


o 


43 


cu 


O iH 


•H 








•H 


o 




•H CJ 


Cd 










1-1 


3 


d 


u 




CO 


42 CO 


Cd 


cd 


iH 


cd 'H 






d 


60 CU 


•H 


cu 


O 


•H 




CU 


o 






to 


d 


M Q 






•H 


o a 


a. 


<u 


•H 


a. 


•g 


3 


4J 


M d 


o 






O 




fH 


Cd 


42 CU 


u 




CO 




Cd 


O 


•H 




a. 


o 


CU 


a. 


(U 


d 


. u 


Cd 


a. ^ 


•H 


D4 cu 


w 


•H 




cd 




4J 


cd *J 


cu 




o 


H a 






•H 


cd 


}-l 


CO 


u 


^ <u 


rH 




fH 


rH fH 




CU 


Cu 


cu 


fH 




•H 




o 


•H 




< 


cu 


O 


:^ £ 




4J 


< 43 



H 



d 

CO 



s 

i 

Co 



d 
o 

•H 
4J 

Cd 

d u 
o o 
•H a. 

4J u 

cd o 
o 

d 

3 cu 
O -H 

GO 



T3 
M 
O 

fa 



d 

o d 

•H o 

ju .H 

Cd d 4J 

•^3 D cd 

d fa ^3 

3 d 

O 42 D 

fa 4-> O 

rH fa 

GO Cd 

d G) 42 

•H ^ 4J 

M d M 

CU o o 

4J g iM 

4J B d 

0) o cd 

>4 O Q 



d 
o 

•H 

Cd 
d 

D 

o 

fa 

d 
o 



d 

o 

•H 

Cd 
d 

D 

o 

fa 



4J 

cd 

4J ^3 

cd d 

O D 
3 O 
T3 fa 

4J 

o d 

CO cd 

CO u 

w o 



•T3 4J 

D 4J 

cd o 

X X 



d CO 
o < 



cu U 42 

o cd o 

> o cd 

M o cu 

cu CO CO 

CO CO cu 

< Pi 

GO 

d d d 

•H O O 

4J .H 'H 

CO 4J 4J 

CU Cd Cd 

H O O 

D D 

fH T3 T3 

cd U U 

d 

O fH d 

•H cd cd 

4J d o 

cd O 

U 'H M 

D 4J <u 

T3 cd e 

w s <3 



43 

4J 
rH 

cd 
cu 

PC! 

o 

CO 

cu 

4J 

D 

4J 

•H 
4J 

CO 

d 



cd 
d 
o 

•H 

Cd 



cd 

d 

cu 

•H M-l 
4J O 

Cd 

U (U 

u 



D 

123 -H 4J 

d -H 

M-l 'H 4J 

O S CO 

T3 d 

4J < M 

d 

cu CO rH 

d Cd 43 

cd d 4J 

M O fH 

Cd CU -H Cd 

a. 4J 4J cu 

cu cu cd P3 

Q > a 



B 

4J 



0) 
u 

cd 
a 

CO 

d 

o d 
•H Cd 



cu CO 

CO CO CO 

d 'H o 

0) g *H 



cu o 

tW >^ 

O GO 

4J 1) 

d d 

cu u 
B 

4J o 

cd B 

<x o 

(U 4J 



D 

cd d 

d o 

O 

U 4J 

CU cd 

< u 

4J 

H CO 



d d 

4J T3 

cd < 



cu 

D 
4J CU 
fH O 
D U 

O CU CU 

M g Cd 

GO O 4J 

< CJ) CO 

UH tM 

o o o 

4J 4J 4J 

d d d 

(u cu cu 

BBB 

u u u 

cd cd cd 

cu Cu 

cu cu cu 

Q Q Q 



d 

o d 

•H O 

cd 4J 

4J cd 

U n3 

o a 

CO O 



u cu 

H O 

d 

4H CU 
O 

O 

4J CO 

d 

cu fH 

B Cd 



4J 

M o 

cd 

cd 



o 

43 

4J 

D 
< 

CU 



Cd 
> 

cu 
cu 

CO 
CO 

cu 
a 



ERLC 



i 

Co 



4J 

d 
o 
o 



CO CO 

d u 

o cu 

•H 43 

4J 4J 

Cd O 

3 d 

O cd 

fa 



M 



• 
















al 






er 


g 




T3 






CU 




d 


fa 






U 


cu 


B 


CU 




Ad 




o 




o 



4J 

d 
cu 
B 
d 
u 

o 



'X3 



§ 

U 



CM 



1 



I 



ct; ^ 

8 



0) 


a> 


u 


u 


cU 




C/3 


(A 


Q) 


0) 


U 


U 




D 


4J 


4J 


•H 


•H 


^ . 




C ^ 


C ^ 


CU 0) 


CU (U 






X 3 


X D 


(U fH 


CU fH 


O 


U 


S ^ 


o c 


2: -H 


S -H 



(U 

4J I 

Cti CO 

o 

CO 



I 

c 

CU 

-a 

td o 



CO 
CU 

P j= 
o 

u u 

O 

CO MH 

3 4J 

4J CO 
•H 

C M 

CU S 
P. 

« >^ 

w ^ 



CO 
C 
O 



CO 
CO 
CU 

o td 

U -H 

o 

CO 

4J (0 

•H td 



CO U 

s *^ 

O CO 

•H 3 

CO ^3 



CO 

o 
o 

3 

o 

CO 



^3 
CU 
4J 

td 

•H 
4J 

CO 
CU 

Q 

U 
O 

UH 

CO 
CU 

u 

3 

4J 
•H 

0 



CU 2: 



CO 

c 
o 



T3 
C 
3 



I 
i 

Co 



cd 
u 

•H 
4J 

3 

CU 

o 
td 



cd 



4J 

3 

)-i 
4J 
C 

o 

o 



CO 

c 
o 



§ 

o 



4J 

CU CU 3 

4J g U 

td 5 

> O 4J 

•H -d CO 

- u c c 

P^ u M 



ERIC 



i 

Co 



4J 

c 
o 

o 



a: 



CO 
3 

C 



CO 

1 'd 
C C 
M 3 

iH 

CO td 
0 S 

4J 4J 
3 

T3 4J 
C -H 
3 4J 
O CO 



-17- 



CATEGORIES OF PERFORMERS 

Performance will be measured In man-years of effort instead of 
ntunbers of positions, people, or dollars — in the judgment that level 
of effort is thus most accurately represented. Especially in educa- 
tion, the choice of man-years of effort instead of people or positions 
is significant since much of the R&D effort occurs on a part-time ba- 
sis (Clark and Hopkins, 1969, p. 103). The choice of man-years of 
effort instead of dollars expended is significant, since salaries are 
higher in health R&D than in education and agriculture (probably be- 
cause of competition from medical doctors' salaries). 

To qualify for inclusion in the performer tables, an activity must 
be at the "professional level.** In agriculture this is defined to be 
all research work "at the 'rank* of assistant professor or above," or 
GS-11 or above. Research administrators are not included (U.S. Depart- 
ment of Agriculture, 1967; p. v.). In education, **prof essional level" 
excludes secretarial and clerical effort, and administration performed 
by people who are primarily administrators; but it includes all people 
trained in a specialty relevant to the research activity. Statisticians 
and programmers, for example, are included in the education performer 
data. A director of audio-visual services is included if he does ex- 
perimental work, but not otherwise.^ In health, the professional level 
includes work by *'M.D.s and Ph.D. s and others with less than doctoral 
training who functioned as principal investigator and collaborators. 
In general, this does not include persons with such training who per- 
formed as research assistants; it also excludes technicians and all 
other supporting personnel" (U.S. Office of Resource Analysis, 1969). 

Just as for sponsors, performers were grouped by institutional 
setting in which work was performed. A description of the performance, 
covered in this study along with specific names where possible appears 
in Table 3. Ideally, a list of the performers included in each cate- 
gory should be given, but this information was not available from the 
data sources. 

It should be commented that quality of RD&I performed was not a 
qualification for inclusion in the performer tables. Certainly, some 



Conversation with John Hopkins, co-author of Source C. 
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RD&I activity contributes more to capability than the rest, but, of 
equal certainty, there is no appropriate way to measure that contri- 
bution. 



Ill, COMPARISON OF PERFORMER COMMUKITIES 



COMPARISON BY INSTITUTIONAL SETTINGS 

Etftimates of total performance in the agriculture^ education, and 
health sectors are shovn In Tables 4 through 6. For each category of 
performance estimated » two numbers are shovn; one Is an "expected 
value" and the other, a "standard deviation." As explained In Appendix 
A, the expected value Is an estimate of the actual performance In a 
category. The degree of uncertainty in thlf? estimate is specified by 
quoting the standard deviation. The interpretatlc;^ of these two num- 
bers is as follows: 

(1) With probability .35, the true value of the quantity being 
estimated lies between the expected value plus one-half 
standard deviation and the expectad value minus one-half 
standard deviation. 

(2) With probability .9, the true value of the quantity being 
estimated lies between plus and minus two standard devia- 
tions of the expected value. 

Another interpretation of these quotatione^ is that if the true value 
of each quantity being estimated were known, then on the average 35 
out of 100 true values would lie between the expected value plus one- 
half standard deviation and minus one-half standard deviation* Also, 
on the average, 9 out of 10 would lie within the expected value plus 
and minus two standard deviations. 

As Tables 4, 5a, and 6 show, the largest share of R&D (not RD&I) 
is done by industry (61 percent) In agriculture, and by higher educa- 
tion institutions in education (45 percent) and health (41 percent). 
The second largest shares are conducted by universities (21 percent) , 
and Federal laboratories (17 percent) in agriculture; by local school 
agencies (17 percent) and regional labs (17 percent) in education; and 
by industry (18 percent) and Federal laboratories (18 percent) in 
health. 



^Vhich applies oaly to the subt'^tals and totals. 
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A major difference between the sectors is that over 40 percent of 
the R&D In education and health Is performed in colleges and unlversi* 
ties, whi!)e only 21 percent of the total in agriculture is performed 
in universities (see Table 7). In effect the portion in agriculture 
may be even lower since the bulk of university-performed R&D is con- 
ducted in the 53 State Agricultural Experiment Stations. Thes^i r<&D 
centers are collocated and allied with universities, but are orgmi- 
zationally distinct from university departments. They receive over 
half of their support from the states and industry, and have research, 
development, and innovation responsibilities for their section of the 
country. Both faculty and SAES personnel commonly have joint appoint- 
ments in the two organizations. 



Table 7 



R&D PERFORMANCE, FY 1968 
(man-years) 



^ 

Sector 


Universities 
& Colleges 


Federal T j 
Government j Industry 


Education 

Health 

Agriculture 


2,121 
24,090 
A, 320 


41% 
21X 


85 

10,350 
5,400 


2X 116 
18% j 10,687 
21% ] 15,900 


2% 
18% 
61% 



All Other 



2,3A3 
13,150 



50% 
23% 



Total^ 

4.665 
58,570 
25,620 



Tables 4, 5, 6. 



As shown in Table 7, education and health are unlike agriculture 
in that little of the R&D is performed in industry. Industry performs 
61 percent of the R&D effort in agriculture ^ 18 percent in health, and 
very little in education. The industrial R&D in health is concentrated 
in the drug industry (over 90 percent of the total^) ; whereas industrial 
R&D in agriculture occurs across the entire spectrum of production. 

Table 7 shows that in FY 1968 very little education research was 
performed in Federal agencies (most of it data analysis), in contra- 
distinction to health and agriculture where at l^ast 15 percent of the 
research is intramural. In the health field most of the intramural 
work done by HEW is performed In the Washington, D.C., area, while only 



Conversation with analyst: Office of Resource Analysis, NIH. 
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a small fraction of the Intramural agricultural R&D is performed in 
the Washington area (roug!ily 10 percent). 

The performer chartf» also show that fewer levels of government 
are significant producers of R&D activity in the health and agriculture 
sectors in comparison to education, reflecting the fact that government 
is a major producer of education services. 

The level of educational R&D performed nationally has increased by 
50 percent and the amount performed has doubled since FY 1965 (see 
Table 5b) due to support from ESEA. Compared to the number of elementary 
and secondary school districts (20,000 in FY 1968), however, the level 
is even less than depicted in Table 5a, since much of the education re- 
search effort attributed to local school and state agencies is in the 
domain of data collection and **social bookkeeping** (Clark and Hopkins, 
1969; p. 72). 

COMPARISON BY RESEARCH ACTIVITY 

Due to deficiencies in available data, only the agriculture and 
education sectors can be compared by research activity. Tables 4 and 
5a show that in education more effort is spent on development (2630) 
than on research (2037), while in agriculture, the split is roughly 
equal between research (12,400) and development (13,220). The bulk 
of the development (60 percent) in agriculture is performed by the 
agricultural industry, but they support about two-thirds of the re- 
search, too. 

Comparing entries in Tables 5a and 5b, the emphasis on develop- 
ment in education is a consequence of ESEA, primarily due to the in- 
troduction of the Regional Education Laboratories and development 
projects in the universities and local schools. 

A major difference between the sectors is the small innovation 
effort in education (1,300 man-years) compared to a much lirger one 
in agriculture (15,000 man-ye&rs). Even on a percentage basis, more 
effort is applied to innovation in agriculture, since almost 40 percent 
of total RD&I activity is allotted to innovation activities in agri- 
culture, but only 20 percent in education. These figures are not com- 
plete, however, since not all activities which have innovation effects 
Q have been included in each sector* 

ERIC 
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The small size of the innovation effort in education is indicated 
by the comparison that the 15,000 m/m-years of effort in agriculture 
were applied to a community of 3,000,000 farms (an average of 1.2 man- 
days per year per farm), while 1.3 man-years of effort in education 
were applied to a community of 2,400,000 elementary and secondary 
teachers and administrators'^ (an average of 0.1 days per year per po- 
sition). It should be realized, however, that there are many differ- 
ences in the way this innovation effort is applied. For example, 30 
percent of the formal innovation man-hours in FY 1968 and 50 percent 
in FY 1965 stem from NSF efforts to upgrade science teaching in the 
Secondary schools through teacher retraining programs which encouraged 
the adoption of new science curricula. In these programs a number of 
teachers plus an education profe.ssional were brought together for a 
period of time, giving great leverage to the professional's time. 
Group activities are conducted in agriculture also, but a large share 
of the innovation effort is providing individual consultation service 
to farmers. Thus, the man-years of innovation effort are not strictly 
comparable in education and agriculture, but the order of magnitude 
difference in scale indicates a much greater effort to link R&D with 
practice in agriculture than in education. With roughly the 8 ?itie nuiu — 
ber of teachers as farmers there is more than ten times as much effort 
applied at the local level (11,000 man-years) in agriculture as in all 
of education (1,300 man-years). 

EXPENDITURE OF R&D FUNDS BY PERFORMERS 

The distribution of performers among R&D institutions in the econ- 
omy as a whole can be compared to the distributions in agriculture, 
education, and health by examining performance (in dollars consumed) 
by institutional setting. As Table 8 shows, the education sector is 
distinct from the total national R&D effort in the high percentage of 
R&D done at universities and the low percentage done intramurally (by 
the Federal government) and by industry. 

■^Saturday Review of Literature^ Sept. 19, 1970, p., 67. Inclusion 
of college and university teachers and administrators would add over 
900,000 more positions. 
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Table 8 



EXPENDITURE OF R&D FUNDS BY PERFORMER, FY 1968 
(millions of dollars) 



Sector 


Universities 
& Colleges 


Federal 
Government 


Industry 


All Other 


Total 


Education^ 


113 


60% 


2 


1% 




4% 


65 


35% 


188 


Health^ 


874 


36% 


362 


15% 


695 


29% 


465 


19% 


2,396 


Agriculture^ 


173 


22% 


159 


20% 


460 


58% 




0% 


792 


All Sectors'* 


3,400 


12% 


3,650 


13% 


19,250 


70% 


1,085 


5% 


27,380 
.... 



^U.S. Cfffice of Education, 1969, p. 91; increase Federal agencies 
(except USOE, NSF) and foundations by 20% (see Note b. Table D-1) . 
^Table 6. 

^U.S. Department of Agriculture, 1969; and Appendix E^ 
^National Science Foundation (NSF 69-30) 1969. 
^Appendix D, Table D-1- 



The correlation between percentage of R&D man-hours in an institu- 
tional setting (Table 7) with the percentage of R&D dollars consumed 
in an institutional setting (Table 8) is very high for the health and 
agriculture sectors, but somewhat lower for education (45 percent, of 
the education man-hours are performed in universities, but 60 percent 
of the dollars are consumed. This discrepancy could be caused by (1) 
the necessity due to data limitations of including some education in- 
novation money in Table 8 (much of which goes to the universities) , 
and (2) better pay in universities than in most other settings where 
educational R&D is performed. Neither of these factors could be in- 
vestigated further. 
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IV > COMPARISON OF SPONSOR COMMUNITIES 

COMPARISON BY INSTITUTIONS 

The levels of sponsorship by institution and research activity 
are shown in Tables 9, 10, and 11. 

The most striking result is that the Federal government supplied 
over 87 percent of the funds for education R&D in FY 1968 (see Table 
12). The federal share was not as large (64 percent) in health, and 
even smaller (27 percent) in agriculture. The Federal share of sup- 
port for all R&D sectors is slightly less than in health (55 percent) . 

State governments support R&D to a great extent in agriculture, 
but minimally in education and health. Based on a survey of all the 
states,^ it has been estimated that State Departments of Education 
spent approximately $1.5 million on research and development in 1965. 

With the advent of ESEA Title V in 1966, it is unlikely that state 

2 

support for R&D had increased by much in FY 1968. Thus, support in 
FY 1968 was probably in the neighborhood of $2.0 million. The situa- 
tion is much different in agriculture where the states have histori- 
cally provided a large share of the funds (50 percent in FY 1968) for 
R&D performed in the State Agricultural Stations. In the health field. 
Table 12 shows that state government supplies a relatively small per- 
cent of the R&D funds, although that represents many more dollars than 
in education. 

The industrial contribution to R&D correlates with the size of 

industry in the sector. Agricultural industry, which is the largest, 

spends the most on R&D, while a lesser amount is spent by the smaller 

pharmaceuticals industry. Education which has a negligible industrial 

3 

component receives negligible R&D funds from industry. There is no 

■^^hillips, 1967; Table XVIII. 
2 

It is assumed that the availability of Title V funds at the Federal 
level for RD&I in State Departments of Education is more likely to re- 
place state support of KD&I than to encourage it. 
3 

According to U.S. Office of Education, 1969, p. 65, "The role of 
private industry in educational research and development has proven very 
difficult to ascertain.'* These authors decided not to estimate sponsor- 
ship by private industry, and no other precise figure could be found. 
The estimate quoted for industrial R&D in Table 11 is discussed in App. F. 
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Table 12 

FEDERAL SHARE OF RiJ) SPONSORSHIP, FY 1968 
(millions of dollars) . 



Sector 


Federal 
Government 


State 
&t Local 


All Other 


Federal as 
Z of Total 


Govt, as 
1 of Total 


Education^ 


150 


2 


20 


87 


88 


Health2 


1,527 


69 


799 


64 


67 


Agriculture-^ 


210 


122 


460 


27 


42 


All Sectors^ 


15,000 


500 


11,900 


55 


57 



Table 10. 
Table 11. 
Table 9. 

National Science Foundation (NSF 69-30), 1969, p. U. 



evidence in these figures that federal sponsorship stimulates or re- 
places Industrial R&D activity. 

Non-profit institutions and private individuals contribute a siz 
able ($185 million or 7 percent in FY 1968) portion of the funds for 
health R&D. The shares of sponsorship by non-jDtofit sources in agri- 
culture ($22 million or 2 percent in FST 1965) aftd in education ($7 
million or 4 percent in FY 1968) are much smaller (U.S. Department of 
Agriculture, 1966, p. 54; U.S. Office of Education, 1969, p. 117). 

Table 13 



RATIO OF DEVELOPMENT TO RESEARCH SPONSORSHIP, BY 1968 
(millions of dollars) 





Research 
Sponsorship 


Development 
Sponsorship 


Development 
Research 


Mean 


Std. 


Agriculture^ 

Education^ 

Health3 

All Sectors^ 


379 
93 
2,446 
10,000 


413 
79 
949 
17,400 


1.09 
.85 
.66 

1.74 


.28 

.15 

.13 
? 



^Table 9. 
^Table 10. 
TTable 11. 



National Science Foundation (NSF 69-30). 1969. p. 14. 
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COMPARISON BY RESEARCH ACTIVITY 

The agriculture, education, and health sectors are different fron 
the econony as a \/hoIe in that a snaller proportion of R&D funds are 
spent on developnent (see Table 13). In the econony as a whole, develop^ 
nent expenditures are 1.74 tines research exp^enditures, vhile for agri* 
culture, education, and health comnunities the ratio is close to or less 
than 1. As a caution, however, the level of uncertainty in the ratio 
for agriculture is high conpared to the other sectors. As Tables 5a 
and 5b demonstrated, the relatively large ratio for education is a post* 
FY result, steaming fron enphasis on development in ESEA. 

THE COST OF RfcD EFFORT 

The cost of R&D effort in the various research activities can be 
measured by finding the ratio of sponsorship to performance (see Table 
14). For agricultural research and developiDent , the ratio is in the 
neighborhood of $31 ,000/man-year. For health, it is somewhat higher at 
$41,000/man-year, reflecting possibly greater use of technicians and 
equipment, and competition from medical doctors* salaries. 



Table 14 
COSTS OF R&J) EFFORT, FY 1968 







Man- Years- 




SECTOR 


Sponsorship^ 


Purchased 


Ratio 


Activity 


($ millions) 


(thousands) 


$ /Man- Year 


Agriculture 








Research 


379 


12.4 


30.600 


Develofment 


413 


13.2 


31,300 


Innovation 


241 


15.0 


16.100 


Education 








Research 


93 


2.0 


46.500 


Development 


79 


2.6 


30.300 


Innovation 


66 


1.3 


50.700 


Health 


2395 


56.3 


41.100 


All Industry^ 






46.000 



tables 8, 9, and 10. 

2 

Tables 4, 5, and 6, 

^Cost per scientist and engineer quoted in National 



Science Foundation, 1970. R£J) in Industry generally 
costs more than in universities and government. 
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In education, development costs about $309000/nan^yefir9 but re** 
search Is more expensive at $A6,500/man*year. This figure Is probably 
higher than the actual number. 

The most likely source of this discrepancy Is u!iderestlmatlon of 
Individual producers In the university setting. Comparison of Tables 
I^^l and B-2 shovs that vlth few exceptions, over 90 percent of the R&D 
in the university setting In FT 1968 was supported by USOE or NSF pro- 
grams, an unexpectedly high number. This fraction vould decrease If the 
data for Individual producers In FY 1968 (Table B-I) In the university 
setting were Increased. These data were oibtalned by Inflating Clark 
and Hopkins >^stlmates of the number of Individual performers In FY 1965 
by the growth In Federal programs. If Clark and Hopkins estimates of 
university performers In FY 1963 are low then the estimate of perfor* 
mance In tbe university setting In FY 1968 would also be too low. 

The estimates of university performers In FY 1961^ (by Clark and 
Hopkins, 1968) were based on a survey of the total population of educa- 
tion RfcD performers, but especially In non-school of education settings; 
only a small correction for non-^respondence was made. Actual activity 
was estimated to be less than two tinges larger than the number of re* 
turned questionnaires. If Clark and Hopkins had tripled or quadrupled 
(tantamount to a 33 percent or 25 percent sample return) their estimates 
for the Individual producers in the non-school of education/university 
setting, the cost per man-year ratio for research would have turned 
out to be $35,000, and the ratio for development would not have changed 
very much. 

The ratio for research can also be reduced to $35,000 without chang- 
ing the ratio for development by dropping NIMH and KIH from the list of 
sponsors. This 1,9 further evidence that individual performers in non- 
school of education settings have been undercounted, since many NIMH 
and NIH grants go to these performers. 

Even so* the per man-year costs of research and development are 
the same order of magnitude, and very close to the costs in other sec- 
tors. Since the figures for education performance and sponsorship are 
based on independent sources of data, the close agreement gives confi- 
dence that no large block of education fJLD activity has been seriously 
underestimated on either the performer*s or the sponsor*s side. 

ERLC 
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TH£ COST OF INNOVATION EFFORT 

According to T«ble K, the Innovation effort in education is sub- 
stantially more expensive per man^year in education ($50,000) than in 
agriculture ($16,000). Innovation is more expensive in education be* 
cause NSF's teacher retraining programs are a substantial part of the 
education format. NSF's procedure is to bring teachers together from 
all across the country for workshops, making it necessary to pay travel 
and subsistence expenditures. The format is less expensive in agri* 
culture^ since it involves extension agents working with farmers on 
their own farms. The differential , however, is not as high aS it ap* 
pears in Table 14, since the cost of office space supplied by univer* 
sities and government is not included in the agriculture sector. Even 
the approximate magnitude of this overhead cost is not readily avail* 
able from government or other sources. 

SCALE OF SLCTOR ACTIVITY 

The absolute levels of K&D sponsorship are n^ innedia tely com- 
parable without establishing a measure of the scale of production acti- 
vity. A natural measure to use is the contribution to CNP produced in 
each sector. R6J) activity can then be compared by specifying its size 
as a percentage of value added in a sector. Table 15 shows the contri- 
bution to CNP for the agriculture, education, and health sectors in 
FY 1965 and FY 1968. 

As a percentage of sector product, education R&D has remained near 
3 percent in the years FY 1965 and FY 1968. At the same time, expendi- 
tures for health- related R&D decreased from 5 percent of aector product 
to 4.7 percent. The agriculture expenditures for R£J> were 1.1 percent 
ol the sector product in FY 1968 and 1.2 percent in FY 1965. 

In the economy as a whole, about 3 percent of the GNP is invested 
in research and development activities. These figures are displayed in 
Table 16. 

HISTORY OF R&D SPONSORSHIP BY PRIMARY AGENCIES 

The cross-section views of R&D activity in FY 1965 and FY 1968 do 
not capture the dynamics of investment in RU), since several years are 
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Table IS 

SECTORAL CONTRIBUTION TO GNP 
($ billions) 



Sector 


CY 1965 


CY 1968 


Agriculture 

Cross Farm Product^ 

Food snd Kindred Products Hanufscture^ 
Tobscco Kanufscture^ 
Lumber and Wood Product Manufacture^ 
Paper and Allied Products Manufacture^ 
Textiles Manufacture^ 


23.70 
21.00 
3.30 
4.80 
7.10 
6.10 


24.90 
23. 10 
3.60 
5.70 
8.70 
7.50 




66. DC 


73.50 


Education 

Private Consumption^ 
Purchases of Structures^ 

CoverniDent Purchases (Znm^M And Servlcei^ 
Federal 

State and Local 


5.59 
.75 

.42 
29.82 


8.40 
.98 

.78 
42.86 




35.58 


53.02 


Health 

Private Consumption^ 
Purchases of Structures^ 

Governmenc Purchases, Goods and Services^ 
Federal 

State and Local 


28.08 
1.40 

2.07 
5.87 


38.58 
1.57 

2.55 
8.76 




37.42 


51.46 



All references* U.S. Office of Business Economics, 196^. 

1. Table 1.17. 

2. Unpublished figure for value added.^ Vllllan Elaenberg, 
Office of Bualneas Econonlcs^ U.S. Department of 
Come roe. 

3. Table 2.5, Item X. 

4. Table 5.2, Private, Educational New Construction. 

3. Table 3.10, Government Purchases, Goods and Services. 

6. Table 2.5, Medical Expenses. 

7. Table 5.2, Private Stt^icturea, Hospital and Institutional. 

8. Table 3.10, Lines 21, 37. 
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Table 16 

R&D SPONSORSHIP AS A FRACTION OF GNP 





R&JD Sponsotiihip 
($ milliona) 


Sector Product 
($ billions) 


Ratio 

(percent) 


Sector 


FY 1965 


FY 1968^ 


FY 1965 


FY 1968 


FY 1965 


FY 1968 


Agriculture 

Education 

Health 

All Sectors 


791^ 
100^ 
1,8A03 
20,500^ 


792 
172 
2,395 
25,330 


66.00 
35.58 
37.42 
684.80 


73.50 
53.02 
51.46 

>J65.70 


1.20 
.28 
5.00 
3.00 


I.IO 
.32 
4.70 
2.90 



Hj.S. Department of Agriculture, 1966; p. 52. 

^U.S. Office of Education, 1969; pp. 128, 129, 116. 
3 

U.S. House of Representatives, 1971; p. 43. 
National Science Foundation (NSF 69-30), 1969. 
^Tables 9, 10, and 11. 



thought to be required for R&D results to diffuse into practice. To 
better represent these dynamics, the level of RM) expenditures can be 
examined over a number of previous years. 

The historical trends of R6J) activity supported by the primary 
governjnent agencies in Agriculture, education, and health are displayed 
in Fig. la. No time series data for other sponsors were found. The 
same data plotted in Fig- la are replotted in Fig. lb after normalizing 
thexB to the level of sponsorship in FY 1964, and deflating the result by 
6 percent per year to account for increasing coat of a research man-year 
(U. S. Office of Resource Analysis. 1969. p. 36). 

Figure lb sh.Tws that the National Institutes of Health have in- 
creased their sponsorship of RM) dramatically in recent years, while 
agriculture has supported research at about the same level for a long 
time. The Office of Education is a newcomer to the R&D field, having 
provided significant support starting only in 1962. National Science 
Foundation's education effort started somewhat earlier, in the late 50a. 
While no data are available, there is no reason to suspect that non- 
Federal government sponsorship of education R&D has increased signifi- 
cantly in the last ten years. Since the Federal government now provides 
over 80 percent of the funds for education RU), the total money provided 
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for education R4D prior to the 1960s was, therefore, probably very 
snail. If » as some have argued* 10 to 20 years are required to trans- 
form knowledge Into products » then the great payoffs for the recent 
Increases In health and education research are yet to cone. In contrast, 
agriculture has received generous support for R&D for many years, and, 
as might be expected, manifests a lively pace of innovation and change. 
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1957 58 59 60 61 62 63 64 65 66 67 68 69 

Fiscal year 

Fig. la — Sponsorship of research and development by primary agencies 
In fhe agriculture^ education^ and health sectors 
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i,8r 

Nofe: fhfs ffgure obfamed by deflaffng 
1.7" data in Figure la by 6% per year 



1.6 - 




1957 58 5 9 6 0 6 1 62 63 64 65 6 6 6 7 68 69 



Fiscal year 

Fig, lb — Sponsorship of research and development by primary agencies 
rn agriculture, education, and health sectors 



V, ADDITIONAL COMMENTARY ON THE RESULTS OBTAINED 



Against the often heard statement that "development is much more 
'expensive* than 'research*'* is the fact that even in the sectors with- 
out significant industry, roughly as much is spent for research as is 
spent for development. Individual research projects are generally 
smaller than development projects and thus cost less, but apparently 
many more are supported. If it is assumed that the balance between 
intrasectoral R&D shown in Tables 4 through 6, and 9 through II is 
optimal, then it follows that the expected marginal payoff from research 
in each sector equals the expected marginal payoff from development . 
Since roughly the same input of dollars is spent on each mode of acti- 
vity, it would just as well be said that research is as "expensive" as 
development. This string of argument only points out the fallacy of 
stating that development is more expensive than research. The important 
issue is not expense, but that the total budget in a sector is divided 
to equalize the marginal payoff for research, for development, and for ; 
innovation. This prescription is more of conceptual than practical use, 
however, since this optimal level cannot be determined analytically* 

The marginal payoff from RD6eI should also be equalized between 
sectors so that the last dollar spent on RD&I should be expected to re- 
turn ^s much in education as in health or agriculture, but again this 
prescription is not useful because a means of calculating these marginal 
payoffs is not available. Thus, even though this study shows that educa- 
tion RD&I expenditures are very low in comparison to agriculture and 
health expenditures, the evidence given does not mandate * more or less 
support for education RD&I. 

Nevertheless, it is difficult to ignore entirely the proposition 
that support for education BJScD is too low; that increased expenditure 
on R&D would not more than pay for itself in increased educational ef- 
fectiveness. In the industrial sectors, there is scientific evidence 
that expenditures on R&D produce significant increases in productivity. 
One study estimates that a 1 percent increase in R&D generates from a 
.1 to a .7 percent increase in productivity (Mansfield, 1968). Another 
study in the chemical and drug industries has estimated that the rate 
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of growth of productivity is much more a consequence of investment in 
R&D than capital equipment (Minasian, 1962). Especially in a labor- 
intensive industry such as education, it is reasonable, though not prov- 
able, to expect that investment in R&D will enable more to be done per 
unit of labor input. 

Rather than attempting to calculate the marginal payoffs of educa- 
tional KD6cl or estimate increases in productivity, it seems more fruit- 
ful to search for imperfections in the way money is allocated to educa- 
tion which result in a suboptimal share of resources. There is a 
.variety of imperfections which can be postulated. One is that the re- 
cord of educational R&D is poorly known; that is, more has been achieved 
than is realized by those who set budget levels. The argument is that 
if the results were better known, more support would be forthcoming. 
Another is that educational R&D suffers from a critical mass effect; 
that increases in support could substantially increase the marginal 
payoffs in education R&D. 

Perhaps a more plausible imperfection is that an alternative ap- 
proach to managing the conduct of education R&D might significantly 
improve the payoff gained for money spent. The traditional, piecemeal 
approach to R&D may work in other fields such as health or agriculture, 
where a component of the system can be examined in the isolation of a 
laboratory, but it may not work as well in education where a component 

of the system cannot be extracted so easily. If so, a programmatic 
X 

approach which grapples with at least chunks of the system at once and 
features large-scale experiments and careful research designs may pro- 
vide substantially larger returns than those gained from equal expendi- • 
tures on piecemeal projects. Borrowing economic terms, this argument 
amounts to asserting that the "production frontier" for education R&D 
can be shifted outward by managing the expenditure of funds in a 

^Programmatic research and development can be characterized as a 
sustained, "multi-issued," interdisciplinary approach to solving com- 
plex problems. It is a managed interplay among a diagnostic phase 
of sorting out S3rmptoms and causes, a knowledge-building phase of re- 
searching critical questions, and a design phase of testing the results 
for correctness. Programmatic research and development is not a tech- 
nique like PERT-charting or cost-benefit analysis, but a strategy for 
solving problems, ' 
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different way. Because of differences in the nature of the subject 
being researched, the same argument may not hold for health and agri- 
culture. 

Other imperfections may be found in understanding why a government 
policy to fund the building of a knowledge base does not necessarily 
trigger a nt>n-j^overnment effort to exploit that knowledge. As Table 12 
shows, 88 percent of the education and 67 percent of the health R&D 
dollars come from government, while only 42 percent of the agriculture 
R6cD dollars come from (government. Yet, as Tables 9, 10, and 11 show, 
non-govemment-sponsored development effort accounts for 29 percent of 
the total dollars for R6cD in the agriculture sector, 17 percent in 
health, and only 4 percent in education. Assuming that government re- 
search merits utilization, apparently there are circumstances where 
development effort must be stimulated along with research for research 
to be transformed into developed products. Government can do this by 
selecting patent policies, fostering demand for innovative products 
and ideas, or undertaking the job of development itself. Analysis of 
the reasons why non-governmental support for development and innovation 
does not always occur, should suggest the most workable remedies. 
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Appendix A 
PERFORMERS OF EDUCATION RD&I, FY 1965 

Quotations for man-years of education R&D by institutional setting 
and research function in FY 1965 were developed by transforming data 
from Clark and Hopkins' manpower study (Source C, Table 9, which is re- 
produced as Table A-1 here) into the format laid down in Chapter 2.0. 
The transformations needed for this conversion are developed in this 
appendix. The language of probability theory will be used to describe 
the construction of these transformations. Besides its explicitness , 
using probability theory has two benefits: 

(1) It emphasizes that both hard data and subjective knowledge 
are incorporated in the resulting estimates, and 

(2) It provides a means for making quantitative statements about 
the degree of uncertainty in the resulting estimates. 

To begin, two families of random variables are assigned: 

P^c = total number of positions held in FY 1965, and 
^65 " tot^l man-years of effort in FY 1965. 

Individual members of these families are identified by specifying three 
parameters which isolate a particular work group that the random vari- 
ables describe* These parameters are: 

I = Institutional setting (a list of settings appears in Table A-1) , 

J =« Job role (list of titles appears in Table A-1) , and 

R = Activity class (a list of activities appears in Table A-2) . 

With these definitions, the random variable Pg^(I,J,R) is the number 
of positions held in work group (I,J,R) in FY 1965, and A^^(I,J,R) is 
the man-years of effort in FY 1965 in work group (I,J,R). 

Following the theory of subjective probability developed by .lavage, 
a person's a priori state of information about the true value of an 
uncertain quantity can be described by specifying a probability distri- 
bution over the uncertain quantity. The person translates his knowl- 
edge into a probability distribution by comparing standard or normal 
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Table A- 1 

P^jd.J)— RD&I POSITIONS BY INSTITimONAL SETTING AND JOB ROLE. FY 1965 

JOB ROLE J 



Institutional Setting » I 



Colleges & Universities 
Schools ^ Colleges of 

Education 
Schools & Departments 

of Psychology^ 
Other Behavioral and 

Social Science Depts.^ 
Other Discipline and 

Academic Areas^ 
College and University 

Administration Areas 

U.S. Office of Edu-^iation 

State Depts* of Educ. & 
Other State Agencies 

Schools & School Systems 

Private Research Institutes 
L Agencies 

Professional Education Assns. 

Other Professional* Public » 
& Lay Associations 

Interagency Organizations 

Business & Industrial 
Organizations 



RD&I Program 
Directors 
and Staff ^ 

Mean* ^ Std.-*^ 



269 

110 

75 

262 

151 
35 

255 
275 

303 
90 

278 

54 

152 



85 
30 

I 

15 

124 

43 
7 

92 
59 

100 
20 

113 
13 

50 



Individual RD&I Personnel^ 



Hard-core 
Producers 



Mean 



115 
69 

120 
56 

31 

25 
10 



Std. 



36 
24 
44 
28 



Regular 
Producers 



! Mean 



Std. 



Occaa lonal 
Producers 



Mean 



I Std. I 



NSF Supported 



Teacher Instl 
II tute Projram^ 

Mean ' Std. 



375 



56 



11 
4 



265 


78 


, 620 


90 


225 


58 


351 


89 


212 


68 


, 278 


88 


104 


33 


' 178 


50 


7 


■ 


48 


4 


46 




23 


3 




7 


65 


15 


120 


57 


: 140 


43 




Sub-Totals 



Mean 



Std« 



Mean - ElP^^Cl.J)]. 
'''Std- - Standard deviation of P^^d.J). 

^Clark and Hopkins^ 1968; Tables 8» 9» and 56* Let the mean of P..(I»J) be the values in 
Table 9. To the progcsai directc;:B and staff category* add project directors and staff (Table 
8)» and NSF*CCI positions (Table 56). NSF-CCI positions are added because none vere included 
in Table 9 (see Source C» p. 100). Let the standard deviation be one-half the estlnated mean 
minus the documented minlmuoi for program directors and staff (Table S) • 

2 

Appendix C, 
3, 



'Increase '^Individual. • , '* category by 50 percent over values In Table 9, Source C. 
c^uthprs of Source C gave very little compensation for undercounting in this category. 

Increase "Individual. • category by 200 percent. 



The 
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lotteries against lotteries on the uncertain quantity in the following 
way* Suppose the author is offered a choice between two lotteries. 
One lottery is a "coin*' which turns up a head with probability p and 
a tail with probability 1-p* The payoff for a head is W, and for a 
tail is L. The other lottery pays off V if the random variable in 
quesMcr. is greater than K^, and pa>s off L If the randois variable la 

less than K • For conc/etenesc, assume that this random variable is 

o 

P^^(I,J,R). The author selects a value of p « p* where 0<p*il, such 
that he feels indifferent between the two lotteries offered. The se- 
lected value p* is then defined as equal to the subjective probability, 

Pr {P,c (I » J ). By repeating this indifference test for other 

oj o 

values of K^^ the author's a priori state of knowledge about P^^dfRf^J) 
%s specified* A more detailed explanation of the siibjective probability 
concept can be found in Raiffa, 1968, or Savage, 1954. 

Additional knowledge about the true value of Pgj(I,J,K) will "nar- 
row" the author's subjective probability distribution for P^^d.J.H), 
by reducing the range of value'^ over which the true value of Pgj(It-»R) 
will be thought to lie. This is the important feature of the subjec- 
tive probability concept which will be used to quantify uncertainties 
in the performance and sponsorship tables in this report. 

A.l >?ODEL rcn TRANSFORMING EDUCATIC»J RD&I PERFORMER DATA 

E^ch position in a work group (I, J) generates no more than a man- 
year of RD€iI activity; thus » positions in work group (I, J) are related 
to man-years of activity by a constant value of less than one; 

A^jd^J) - e^3(I.J)Pg3(I,J> (A-1) 

The units of e^^d^J) are obviously total man-years divided by total 
positions . 

Since only si fraction of the total activity in work group (I,J) 
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ts devoted to Activity clmns R; Agj(I,J,R) is related to A^j(I.J) by^ 

Agjd.J.R) - ag5(I,J.R)A^5(I.J). (A-J) 

The fraction ag^(I»J»R) is « randocn variable since only partial data 
on its value are available. Since ^A^^d ,J,R) - A^^d^J), necessarily 

From Equation A-2 it is clear that the ^^3*0 unitless quantities. 

Substituting £q. A-1 into Eq. A-2, and susming over all Job roles 
gives the man*years of activity in work group (I,R), a quantity de- 
sired to describe education R&D performance. 



Data are available for all the quantities on the right-hand side of Eq. 
A-4, and so it vlll serve as the basic equation for transforming educa- 
tion data into man-years of performance. Before proceeding, however, 
a further assumption needs to be made. 

This assumption is that given a work' group tl»J»R)» the random 
variables agjd»J,R), 6g3(I,J), and Pgj(I,J,R) are independent. 

Assumption 1 . For any work group (I,J,R), the random variables 

agj(I,J,R), 6gjd,J)» and P^j(I,J) are independent. 

This assumption holds if and only if being told the exact value of one 
of these variables does not change the author's state of information 
about any other of the random variables. For example, if being told 



In the data sources a position was added to an activity class R* 
if more time was spent on activity R than any other activity. Thus 
a^5 is the fraction of positions in a research class and does not di- 
vide a person's tiaa Into the activity classes* 



-51- 



the exact value of P^^d.J) made the analyst change his subjective 
distribution for 6^j(I,J), then Assunption 1 would not hold. 

A>2. EXPECTED VALUE OF EDUCATION RD&I PERFORMANXE 

Display of the probability distribution for A.^,(1,R) in every work 
grc^up is clearly Injpractical. Instead the expected value of A.^(I.R) 
will be arbitrarily adopted as a suitable estimate of the true value 
of A^jd.R). Taking the expected value of Eq. A-4, and invoking the 
independence assumption (Assumption 1) gives the model used to trans- 
form the data in Table A-1 to the desired result in Table A-2. 

El^jd.R)) -E^IV^^J.R)] ElB^jd.J)] ElP^jd.J)]. (A-5) 

Setting Ela^jd.J.R)] - a^^(I.J,R) and Eli^jd.J)] - t^5(I.J)~an 
abbreviation that will be used throughout these appendices — Eq. A-5 be- 
comes : 

ElA^jd.R)) -La^jdtJ.R) 6^5(I,J)]EtP^5(I.J)]. (A-e) 

The subjective estimates and B^^ used in calculating Table A-2 are 

developed in Table A-3 and A-A« The annotations bel«^ these tables 
Indicate the soigrces of data* and the specific assumptions used in es- 
timating the a^j's and the ^55*8^ 

In general the procedure used to estimate all input quantities 
(the a^j's, 6^5*s and E [P^^ (I , J) ) ' s) was as follows. By Integrating, 
it can be shown that for the Beta, Gamsna, and S^^oraal probability dis- 
tributions, approximately ".35 of the probability" lies between plus 
and minus one-half standard deviation of the mean, and approximately 
**.90 of the probability*' lies between plus and minus two standard 
deviations of the mean* Since these three families of distributions 
are robust; enough to adequately describe a state of information for 
any of the input quantities to be estimated, this interpretation ap- 
plies for all these quantities. Thus, the procedure for estimating 
each input quantity is to match a choice of mean value and standard 
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Table A-2 

A (I,R)-.MAN-'i'LARS OF RESEARCH ACTIVITY BY INSTITUTIONAL SETTING, FY 1965 





Research Activity. R 




Basic and 
Mission* 
Oriented 
Research 
(R-l) 


Development 
Activities 
(R-2) 


Innovation 
Activities 
(R-3) 


Subtotals 


Setting. I 


He an 


Std* 


Mean 


Std 


Mean 


Std 


Mean 


S..d 


Pi^nlleffefi and L^nivprsitlps 
Schools and Colleges of 

Education 
Schools and Departn^nts 

oi Psychology 
\/k.iiKL Dencviorsi shq 

Social Science Dcpts 
Other Discipline and 

Academic Areas 
v^ojLiei^e sno univeiBiLy 

Administration Areas 


1321 

/COON 

(582; 
(25,8) 
(270) 
(132) 
(79) 


177 
(K8) 
(60) 
(59) 
(35) 
(36) 


552 
(155) 
(66) 
(^8.3) 
(219.26) 
(63.6) 


147 
(84) 
(36) 
(33) 
(105) 
(33) 


616 
(102; 
(42) 
(37) 
(44) 
(16) 


110 

(67; 

(28) 

(18) 

(42) 

(41) 


2492.7 
(ot»i ; 
(367) 
(355) 
(396) 
(159) 


(214) 
(137; 
(56) 
(61) 
(123) 
(42) 


u.o. uiiice oi jLoucacion 


76 


10 


9.0 


5 


5 


3 


90 


10 


State Departments of Educa* 
Lion a no uLner DLaLe 
Agencies 


157 


122 


59. > 


57 


77 


80 


294 


89 


Schools and School Systems 


162 


51 


158.8 


64 


45 


40 


365 


66 


Private Research Institutes 
and Agencies 


130 


72 


129.5 


72 


29 


61 


288 


96 


Professional Education 
Assoc lat Ions 


28 


30 


28.2 


22 


28 


22 


86 


20 


Other Prof esslonal » Public* 
and Lay Associations 


8 


\U 


2R.0 


92 


42 


32 


264 


108 


Interagency Organizations 


17 


17 


16.9 


13 


17 


13 


51 


126 


Business and Industrial 
Organizations 


39 


19 


76.5 


36 


29 


17 


144 


48 




1938 


236 


1244 


210 


888 


169 


4074 


286 



*Mean « £ [a (I.R)]. 



Std * Standard deviation of A^j(I,R). 

^Man<*years In NSF teacher Institutes are also included. 
SOURCE: Equation* A-5 and A- 10; rablea A-3, A-4, and A-5. 



ERLC 



-sa- 



lable A-3 

^,.(1. J)--THE FRACTION OF A MAN-YEAR DEVOTED TO RESEARCH ACTIVITIES BY 
INSTITUTIONAL SETTING AND JOB ROLE, FY 1965 



Job Rolej_ J 





RD61I 


















Program 


I nd i V i d 


uai RD&I Personnel 


NSF Supported 




Directors 


Hard 


Core 


Regu 


lar 


Occasi onal 


Teacher Insti- 




and Staffl 


Producers 


Producers 


Producers 


tute Program 




(J« 




(J" 




(J- 


3) 


(J- 




(> 




SettlnR, I 


Mean* 


Std+ 


Me a n 


Std 


Me a n 


Std 


Me a n 


Std 


Mean 




Colleges and Unlvprsltles 


















1 . 0 




Schools and Colleges of 






















Education 


.95 


.05 


.90 


.05 


.AO 


.05 


.25 


.05 






Schools and Departments 






















nf Psvchnlnffv 


.95 


.05 


.^yo 


.05 


.AO 


.05 


.25 


.05 






Other Behavioral and 






















Social Science Depts 




OS 


90 


OS 


SO 


OS 




05 






Other Discipline and 






















Academic Areas 


.95 


.05 


.90 


05 


.50 


.05 


.25 


.05 






C n\ \ ^ o ^ l!ni\/f>rcitv 






















A4dml nls tratl on Areas 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






U. S. Office of Education 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 




























and Other State Agencies 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






Schools and School Systems 


.95 


.05 


.90 


.05 


.50 


.05 


.^5 


.05 






Private Research Institutes 






















and Agencies 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






Pr oiessi onal Educational 






















Associations 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






Other Professional, Public, 






















and Lay Associations 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






Interagency Organizations 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 






Business and Industrial 






















Organizations 


.95 


.05 


.90 


.05 


.50 


.05 


.25 


.05 







"^Std « standard deviation 
I 

ClarK and Hopkins, 1968, p. 25. Program directors and staff spend at least two-thirds 
time on education RD6I . 
2 

Ibid. Hard-core producers spend at least two-thirds time on education RD&I. Regular 
producers spend between one-third and two-thirds time; occasional producers between one- 
fifth and one-third. 
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65 



Table 

(I,J,R) — THE EXPECTED FRACTION OF TOTAL EFFORT IN 
EACH RESEARCH ACTIVITY, FY 1965 



Setting. I 



Colleges attd Universities 
Schools and Colleges of 

Education^ 
Schools and Departments 

of Psychol ogy2 
Other Behavioral and 

Social Science Depts*^ 
Other Discipline and 

Academic Areas^ 
College and University 

AdtDinis trat ion Areas^ 

U. S. Office of Education^ 

State Depts of Education 
and Other State Agencies^ 

Schools and School Systems® 

Private Research Institutes 
and Agencies^ 

Professional Education 
Associat ions^O 

Other Professional, ?ublic 
and Lay Associations^^ 

Interagency Organizations^^ 

Business and Industrial 
Organizations^^ 



RD&I 
Program 
Directors 
and Staff 



Job Role a J 



Individual RD&I Personnel 



Rard-Core 
Produc€>rs 
(J«2) 



'65 



(I 



Regular 

Producers 
(J'3) 



,J,l)/ff^5(I,J,2)/-^5(I,J,3) 



Occasional 
Producers 



NSF Supported 
Teacher Insti- 
tute Program 



.33/. 33/. 33 

.33/. 33/. 33 

.U0/.20/.U0 

.03/. 81/. 16 

.50/. 40/. 10 
.85/. 10/. 05 

.1*11.12/ 
.2B/.5b/.lb 

.l*5/.U5/.lO 

.33/. 33/. 33 

.03/. 81/. 16 
.33/.33/.33 

.27/.53/.20 



.85/. 12/. 03 

.65/. 12/. 03 

./fl5/.12/.03 

,85/. 12/. 03 

.50/. 40/. 10 
.85/. 10/. 05 

.85/. 12/. 03 
.85/. 12/. 03 



.85/. 12/. 03 

.85/. 12/. 03 

.85/. 12/. 03 

.85/. 12/. 03 

.50/. 40/. 10 
.85/. 10/. 05 

.85/. 12/. 03 
.85/. 12/. 03 



.85/. 12/. 03 

.85/. 12/. 03 

.85/. 12/. 03 

.85/. 12/. 03 

.50/. 40/. 10 
.85/. 10/. 05 

.85/. 12/. 03 
.85/. 12/. 03 



.00/. 00/1. 00 
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Tabl^ A-5 

Std[a (I, J, R)] --STANDARD DEVIATION OF a (I,J,R), FY 19^5 





Job Role, J 




RD&I 
Program 


Individual RD&I Personnel 


NSF Supported 




Directors 
and Staff 


Hard-Core 
Producers 


Regv^lar 
Producers 


Occasional 
Producers 


Teacher Insti- 
tute Program 


Setting. 1 


Stda^j(I,J,l)/Stdoi^^(I.J,2)Std ^5(I,J,3) 


Colleges and Universities 
Schools and Colleges of 

Educa t ion^ 
Schools and Departments 

of Psychology^ 
Other Behavioral and 

dociai Science uepts 
Other Discipline and 

Academic Areas^ 
College and University 

Administration Areas^ 


.24/.24/.2A 

.lul.iol.iu 

.07/. 15/. 14 
.15/. 14/. 09 


.12/a2/.05 
. 12/. 12/. 05 
.12/. 12/. 05 
.12/. 12/. 05 
.15/. 14/. 09 


.12/. 12/. 05 
.12/. 12/. 05 
.12/. 12/. 05 
.12/. 12/. 05 
.15/. 14/. 09 


.12/. 12/. 05 
. 12/. 12/. 05 
.12/. 12/. 05 
.12/. 12/. 05 
.15/. 14/. 09 


.00/. 00/0. 00 


U. S. Office of Education^ 


.11/. 10/. 07 


.12/. 12/. 05 


.12/. 12/. 05 


.12/. 12/. 05 




State Depts of Education 
and Other State Agencies^ 


.15/. 14/. 14 


.12/. 12/. 05 


.12/. 12/. 05 


.12/. 12/. 05 




Schools and School Systems® 


,15/.16/.ll 


.12/. 12/, 05 


.12/. 12/. 05 


.12/. 12/. 05 




Private Research Institutes 
and Agencies^ 


.15/.15/.10 










Professional Education 
Associations^^ 












Other Professional, Public, 

11 

and Lay Associations * 


.07/. 15/. 14 










Interagency Organirat ions^^ 


.24/. 24/. 24 










Business and Industrial 
Organizations 


.10/. 11/. 10 
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NC TES TO TABLES A- A AND A>5 

1. Of the 269 positions in "Program Directors.../' 70 are in NSF-CCI 
programs, and I2A are in research and service burctaus. The former 
are development-oriented, and the latter research- and innovation- 
oriented* The assigned means reflect roughly an equal split be- 
tween activity classes, with a high standard deviation for each 
value, reflecting the great uncertainty in these estimates. The 
estimates of for ''Individual RD&I Personnel" were assumed to 
distribute as regular research projects (Clark and Hopkins, 1968, 
p. 248). 

2. Of the 110 positions in "Program Directors...," 26 are in NSF-CCI 
programs and at least A8 are in research and service bureaus. The 
same mean values and standard deviations as for Schools and Colleges 
of Education were assumed. 

3* Of 75 positions in "Program Directors...," AS are in research and 
service bureaus. The rest are in other programs. Consequently, it 
was assumed that a higher portion of the work was research and in- 
novation, and a smaller portion was development. Almost complete 
Ignorance of the exact values was assumed by assigning a high stan- 
dard deviation for the research and development fractions. The 
estimates of a^^ for "Individual RD&I Personnel" were assumed to 
distribute as individual research projects. 

4. Most of the "Program Directors and Staff^^ are in NSF-CCI projects 
so the distribution for NSF-CCI projects was assigned for the mean 
values (Clark and Hopkins, 1968, p> 248). Again, individual person- 
nel were assumed to distribute as individual research projects. 

5. Clark and Hopkins, 1968, p. 85. 

6. USOE personnel are primarily engaged in collection of statistics 
or policy research, both of which qualify as research activities. 
Thus, the bulk of activity was assumed to be research. 

7. The mean fraction of "Program Directors and Staff" In each activity 
was distributed as State Research Division Personnel (Clark and 
Hopkins, 1968, p. 248). "Individual RD&I Personnel" were distri- 
buted as regular research projects. 

8. The mean fraction of "Program Directors and Staff" In each activity 
was distributed as Title III Projects (Clark and Hopkins, 1968, 

p. 248). Individual projects were distributed as regular research 
projects, ibid . 

9. Source C, pp. 98-99. 

10. See Clark and Hopkins, 1968, pp. 98^99. The estimates assert com- 
plete ignorance of the fraction of work performed In each category. 
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11. The bulk of the work in this category is NSF-CCI sponsored, so 
activity was distributed as NSF-CCI projects (Clark and Hopkins, 
1968, p. 248). A slight adjustment for the possibility of some 
research was made, however^ 

12. Complet^B ignorance of the activity class distribution was assumed. 

13. A breakdown equivalent to regular development projects was assumed 
(Clark and Hopkins, 1968, p. 248). The performers included in 
this setting are described in Clark and Hopkins, 1968, p. 102, 
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deviation with the state of available information using the Interpreta- 
tion explicated at the beginning of this paragraph. The result of this 
procedure will be a set of quotations for which the true value of each 
quantity being estimated lies between plus and minus one-half standard 
deviation in 35 out of 100 (on the average) cases and between plus and 
minus two standard deviations of the mean in 90 out of 100 cases. 

VARIANCE OF EDUCATION RD&I PERFORMANCE 

Specifying just E[Ag^(I,R)3 fails to convey that A^^CI.R) is an 
uncertain quantity. This difficulty will be remedied by displaying 
the variance of Agj(I,R) alongside E[Ag^(I,R)]. 

The variance is a reasonable choice, since Ag^CljR) is the sum of 
several terms. Therefore, by the Central Limit Theorem, Ag2(I,R) will 
have (at least approximately) a Normal distribution. Since the Normal 
is a two-parameter distribution, specification of its expected value 
and variance fixes its mathematical form exactly. Knowing the mathe- 
matical form, the probability that the true value of Ag2(I,R) lies be- 
tween selected bounds can be easily calculated for any selection of 
bounds . 

To derive an expression for Var[Ag2(I,R)] , make the following sub- 
stitutions into Eq. A-4: 

ag3(I,J,R) - ag5(I,J,R) + ^a^^il,J,R), (A- 7a) 

eg5(I,J) » eg3(I,J) + 6eg3(I,J), and (A-7b) 

Pgsd.J) - E[Pg3(I,J)] + 6Pg3(I,J), (A-7c) 

where ^^f^^* ^^^65* ^^65 small corrections added to the means of 
respectively a^c* 3z:cj ^^<^ Pre* After substitution and rearrangement, 
of Assumption 2, Eq. A-4 becomes: 

Ag5(I,R) - Za53(I,J,R) 3g5(I,J) E[Pg3(I,J)] 
J 

+ Lsogsd.J.R) iggd.j) EEPggd.j)] 

J 
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+ Z]'^65^^'^'^^ «Sg5(I,J) E[Pg3(I,J)] 



+ ]Cag5(I,J,R) 3g5(I,J) 6Pg3(I,J) (A-8) 
+ 2^^ and 3^^ order terms. 



The first term on the right-hand side of Eq. A-8 is clearly ElAg^CljR)], * 

To simplify Eq. A-8, the assumption is made that each error random 
variable in Eqs. A-7 is small in possible magnitude as compared to its 
associated expected value. Then to a "close" approximation (without 
specifying close) the random variable A^^CI^R) equals the sum of its 
zeroth and first order terms. 

Assumption 2 . For any I, J, and R, the error terms Sot^^ (I ,J ,R) , 
63^^(1, J), and 6Pg3(I,J) are sufficiently small 
in possible magnitude with respect to ot^^Cl^JjR), 
e^^djJjR), and EEP^^djJ)] respectively, that 
Ag3(I,R) is approximately, 

Ag5(I,R) ^ E[Ag5(I,R)] 

+ 6ct^3(I,J,R) 6355(I,J)ElPg3(I,J)] 

+ ag5(I,J,R) 63g5(I,J,R) E[Pg3(I,J)] 

+ ag5(I,J,R) 3^5(1, J) 6P^5(I,J). 

In what follows this zeroth plus first order approximation to A^^CljR) 
will be assumed. 

The error random variables 5Pg5> etc., will be small in possible 
magnitude with respect to their associated expected, values (EEPg^l* etc.) 
if there is information available which gives the analyst quite certain 
information about their true values. In the case of Pg^* a head count 
known to cover a substantial fraction of the total population would en- 
able the analyst to assign a low variance distribution for ^^55- 
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an exact head count were available, the error random variable would 
equal zero. Quantitative discussion of the relationship between 
**closeness** and approximation accuracy will appear in a subsequent 
publication. 

The task of calculating Var[Ag2(l>R) ] will be eased by first de- 
ternaining the variance of some simple combinations of random variables # 
These simple results will then be applied to the more complicated task 
of finding Var Agj(I,R). If Z is the sum of two random variables, X 
and Y, then, 

Var [Z] - E[Z - E[Z]]^ 

- E[X - EtX] + Y " E[Y]]^ 

- Var[X] + Var[Y] + 2 Cov.[X,Y]. (A-9a) 

If random variables X and Y are independent, then the second term in 
Eq. A-9a will be zero. If Z ■ XY, where X and Y are random variables, 
then a first order Taylor approximation to 2 is: 

Z - E[X] E[Y] + E[Y](X - E[X]) + E[X] (Y - E[Y]). 

If the random variables X and Y are independent, then: 

Var [Z] =« E[Y]^ Var [X] + E[X]^ Var[Y]. (A-9b) 

Now, whenever a sum of random variables is encountered. Equation A-9a can 
be applied; and if a product of random variables is encountered, Eq. 
A~9b can be applied. 

The variance of Agj(I,R) can be easily written using the opera- 
tions indicated by Eqs. A-9a and A-9b. The result will contain a collec- 
tion of covariance terms like Cov[6agj(I,J^,R) , 6agj(I,J2»R)] » and 
Cov[6agj(I, J^,R) , 63gj(I,J2,R)] , etc. To make all these covariance 
terms zero, it is sufficient to assume that the random variables 
60gj(I,J^,R) , 63gj(I,J2>R) and SV^^il^J^f^) are pairwise independent. 
Since independence is not affected by translation, it is also suffi- 
cient to assume that agj(I,Jj^,R) , ^^^(19^2*^^ I*65(I»J3»R) are pair- 
^ wise independent. 



-61- 



Assumption 3 , For any I, the collection of random variables 
ctgj(I,J,R) for J - 1, 2, ...Nj; B^^d.J) for 
J » 1, 2, ...N^; and Pgj(I,J) for J =« 1, 2, ---Nj 
are paiivise independent. 

The validity of this assumption for education R&D performance can be 
seen by looking at its implication in particular cases. Independence 
between otgj(I,J^,R) and a^^il ^J^*^) * for example, holds if and only 
if knovTledge of otgj(I,J,R) (ex., J « program directors and staff) does 
not change the estimated portion of work devoted to activity R in 
another job role (ex. J " hard core producers). Or, independence holds 
when, and if, knowledge of the portion of time devoted to activity R 
in work group (I, J), does not change the estimate of positions in 
another job role. 

Applying the operations presented in Eqs. A-9a and A-9b to A-8 — 
and using Assumptions 1, 2, and 3 many times, the final approximation 
for the variance of Agj(I,R) is: 

Var[Ag5(I,R)] - ]C { Var [a^^ (I , J ,R) ] (6^5 (I, J)E[Pg5(I,J) ])^ 

+ Sg5^(I,J,R)Var[eg5(I,J)]E[Pg5(I,J)]^ 

+ ag5^(I,J,R)ig5^(I,J) VarlPg5(I,J)] I . (A-10) 

The standard deviation of Agj(I,R) is related to its variance in the 
usual way: 

Std[Ag5(I,R)] - (Var[Ag5(I,R)])2 (A-11) 

Equation A-11 and the data in Tables A-3, A-4, and A-5 were used 
to calculate the standard deviation of each estimate in Table A-2. The 
results are displayed alongside each correspondilng value of ElAgj(I,R)]. 
Assuming that Agj(I,R) is normally distributed, its true vslue lies be- 
tween plus and minus one-half standard deviation of the mean quoted In 
Table A-2 with probability .37, within plus and minus one standard 
deviation of the mean with probability .63, and within plus and minus 
Q two standard deviations of the mean with probability .88. 
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The standard deviation of subtotals over activity classes and 
over institutional settings is also shown in Table The standard 

deviation of Ag^(I), the total activity in institutional setting I» is 
found by first susning Ag^(I»R) over all research activities; and then 
performing the variance calculation. Starting with Equation and 
using Equation A-3: 

AgjCl) - ZBg5(I.J)P65(ItJ)- (A-12a) 
3 

The estlnates of A^^d) are then: 

E[Ag5(I)] -E^esd.-DPfisCI.J). -nd (A-12b) 
Var [Agjd)] - Z{b65^(I.J) Var [P^^ (I ,J) ] + 

Var[6g5(I,J)]Pg5^(I,J)^ . (A-12c) 



Similarly, Che subtotal of research activity over all institutional 
settings is: 

Ag5(R) - LA^jd.R), (A-13a) 

The estimate of Ag^(R) must then be: 

E[Ag5(R)] - EE[Ag5(I,R)l, and (A-13b) 

Var[Ag5(R)] - X}var[Ag5(I ,R) ] . (A-13c) 
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Appendix B 
PERFORMERS OF EDUCATKy^ R&D. FY 1968 

BASIC MODEL 

No direct count of total education RB&I manpower is available for 
FY 1968; thus, it is necessary to extrapolate from the 1965 results. 
The first assumption on which the analysis of this section will rest is 
that the bulk of the growth in man-^years of education RD6.I effort has 
been caused by increases in USOE and NSF funding. A second assumption 
on which analysis will rest is that the FY 1963 man-years table includes 
all education RD6,I work supported by USOE or NSF in FY 1965. 

Under these assumptions the basic model for man-years of perfor- 
mance in activity R in FY 1968 is to add the ?Nin-years of activity R 
supported by USOE or NSF in FY 1968 to the non-USOE, non-NSF supported 
man-years of activity R in FY 1965. This approach is feasible because 
detailed manpower and appropriations data are available for NSF and 
USOE for the years FY 1965 and FY 1968. 

Under these two assumptions the model for man-years of activity in 
FY 1968 is: 
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Aggd.R) - A^gd.R.USOE ^ NSF) + y(1,R). 

{A^jd.R) - A^jd.R.USOE + NSF)} (B-1) 

In Equation B-1, y(I.R) the growth factor for non-USOE, non-NSF 
programs; A^gd,R,USOE ^ 1%S€) is the man-years of effort in FY 1968 
supported by USOE or NSF; and A^^d.R.USOE + NSF) is the same quantity 
for FY 1965. No data on the growth factors are available, but two rea- 
sonable assumptions will be made: (1) that y(I,R) Is very close to 1 
(the growth in non-USOE or non-NSF programs was small, and that (2) 
the growth factors are equal for all groups. The latter assumption 
is conservative In that perfect correlation between y(I,R)*s produces 
greater variance In A,o(^) than If the Y(IfR)*s were Independent or 

DO 

imperfectly correlated. This will be shown shortly. The latter as- 
sumption implies that y(I»R) Y for all I and R. 
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Mathematically, the first assuxnption i8 written as: 



Aasumption 1 . E[y(I,R)] - y(I»R) - 1 + A(I,R) for all I and R» 
where L << 1; and Var Iy(I»R)1 1- 

Mathematically f the second assicBption is written as: 

Assumption 2 . y(I,R) - y for all work groups (I,R), where 
Y is an uncertain quantity. 

As in the previous appendix, the estimate for the true value of 
A^g(I,R) will be the expected value of ^5g(I»R)'» where 

ElA^g(I,R)) - E[A^g(I,R,USOE + NSF)] + y 

{E[A^j(I,R)] - ElA^jd.R.USOE + NSF)] ). (B-2) 

The uncertainty In estimating the true value of A^g(I,R) will be de- 
scribed by quoting the variance of Agg(I,R); where, 

Var[A^g(I,R)] - VarlA^g(I,R,USOE + NSF)] 

+ ^^{Var A^jd.R) + Var A^jd.R.USOE + NSF)> 

/ / 

+ Var[Y] (A^jdtR) + Ag^d.R^USOE + NSF)). (B-3) 

Equations B-2 and B-3 are the models used to obtain the final estimates 
of man-years of FY 1968 education RD&I activity shown in Table B-1, 

Not all the Inputs needed in Eqs, B-2 and B-3 are directly avail- 
able in data sources. Estimates of A^j(I»R) are available (Table A-2) , 
but estimates of Agg(l .R,13S0E NSF) and Ag^d^K^USOE + NSF) are not. 
Developing these estimates is next on the agenda of this appendix. 

USOE AND NSF SUPPORTED PERFORMANCE IN FY 1968 



RD&I positions supported by USOE and NSF programs in FY 1966 and 
FY 1968 have been surveyed by Clark and Hopkins (1968; pp. 237, 238), 
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Table B- 1 

A.-(I,R)--RESEARCH ACTIVITY IN MAN-YEARS BY INSTITUTIONAL SETTING^ FY 1968 





Basic and 
Mission- 
Oriented 
Research 


Dcvcloptwnt 
Activities 
(R=2) 


Innovation 
Activities 
(R-3) 


Subt otals 




Mea n 


Std* 


Mean 


Std"*^ 


♦ 

Mean 


Std"^ 


* 

Mean 


Std"^ 


Colleges and Universities 
Schools and Colleges of 

of Education 
Schools and Departments 

of Psychology 
Other Behavioral and 

Social Science Depts 
Other Discipline and 

Academic Areas 
College and University 

Administration Areas 


1321 
(618) 
(203) 
f206^ 
(102) 

(76) 


177 
(223) 

(85) 
(117) 

(57) 

(38) 


551 
(377) 

(70) 
(160) 
(246) 

(64) 


147 
(112) 

(^2) 

(49) 
(119) 

(35) 


616 
(285) 
(52) 
(66) 
(57) 
(16) 


110 

(76) 

(29) 

(22) 

(^5) 

(41) 


2493 
(1283) 
(325) 
(432) 
(^05) 
(156) 


214 
(252) 

(94) 
(127) 
(156) 

(^9) 


U. S. Office of Education 


76 


16 


9 


5 


U 


3 


90 


17 


State Depts of Education 
and Other State Agencies 


1 Uh 


1 9ft 
1 ^ u 


Aft 


J o 


1 ^ o 


0 1 




1 OA 


Schools and School Systems 


320 


as 


479 


110 


137 


53 


935 


139 


Private Research Institutes 
and Agencies 


129 


76 


126 


75 


28 


81 


283 


108 


Prn f p <i <! 1 nna 1 Ediicatlnn 

Associa tions 


28 


30 


28 


22 


32 


22 


86 


24 


Other Professional, Public, 
and Lay Associations 


21 




232 


103 


57 


34 


310 


122 


Interagency Organizations 
and Educational Labora- 
tories 


72 


UU 


675 


140 


96 


44 


845 


132 


Business and Industrial 
Organizations 


39 


20 


77 


35 


29 


18 


144 


53 


Total 


2037 


501 


2630 


373 


1300 


272 


5970 


854 



*E[A,-(I.R)] . 



Std = Standard Deviation of A^g(I,R), 

^Eqs. B-2 and B-3. Assume average growth in non-Federal programs is 
Y = 1.00 and Std(7) * .15 (5 percent per year). 
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and are presented in Tables B-2 and B-3. To convert these data into 
the desired quantities (nan-years of RD&I activity In FY 1963 and 
FY 1968), two steps are necessary: (1) to convert the FY 1966 posi- 
tion data Into FY 1965 position data, and (2) to convert FY 1965 and 
FY 1968 position data Into man-years of effort by research activity 
and Institutional setting* Conversion of the FY 1968 positions data 
will be completed first. 

The format of the data on positions in Tables B-2 and B-3 is 
slightly different than Table A-1, the positions table for all edu- 
cation R&D. In Tables B-2 and B-3» positions are reported as a func* 
tion of institutional setting and Federal program instead of by in- 
stitutional setting and job role. Thus, Instead of ihe index J, the 
position data are conditioned on the newly defined index K, identify- 
ing the Federal program supporting a position. 

Proceeding with reasoning similar to that in Appendix A, the 
expected man-years of USOE or NSF supported activity in work group 
(I,R) is related to positions in work group (I,K) by 

Aggd.R.USOE + NSF) - ]C oi^|(I»K,R)e^g(I,K)P^g(I,K,USOE + NSF) 

IC 

(B-4) 

where the summation is over Federal programs. 

OE 

Directly relevant data for g^g(I,K) are not available but can 
be derived if it is assumed that the professional positions supported 
by Federal programs have an average cost of roughly $30,000 per man- 
year. Then, by dividing the amount of the FY 1968 appropriation for 
a work group by $30^000, times the number of positions supported in 
that work group, an estimate of the average man-years per position 
is obtained. As Table B-4 shows, many Federal programs have close 
to a $30,000 per man-year cost. Presumably, those w*hich do not in- 
clude a substantial portion of part-time effort* 

Expressing this model in mathematical terms, assign ^gg(I^) ^s 
the wage cost per professional position in Federal program, K. 
Wgg(K) is a random variable, since $30,000 per man-year is an un- 
certain figure. Then, if Bgg(K) is the USOE or NSF FY 1968 appro- 
priation for program, K; and P,-.(K,US0E 4- NSF) is the number of 
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Table B-4 

B,-(K)- -APPROPRIATIONS IN FEDERAL PROGRAMS, FY 1968 



Program, K 


Appropriation^ 
{$ T75illions) 


2 

Positions 


Average 
Cost per 
Posit ivon 
($ thouisands) 


B (K) 


fStd B (K)!"^ 
^ 68 


★ 

Mean 


Std^ 


USOE: 












Centers 












DEL 


8. 10 




360 


18 


22,5 


DCVR 


2 23 




78 




28.5 


DESR 


1.70 






1 
J 


30. ^ 


HCY 


. A7 






1 


23.5 


Policy Study 


1 . 00 




19 


I 


52.6 


Instructional 












Materials 


2.75 




86 


u 


^0.0 


Laboratories 


23.80 




767 


38 


31.0 


Clearinghouses 


2.17 




163 


8 


13.3 


Research Coordi- 












nating Units 


1.05 




175 


9 


6.0 


S t d t p Dpoa r t TTipn t 

k a k c c w a L k 111 c 1 1 k 














2.52 


.25 


321* 


16 


7 8 


Res ear c h 












Small 


1.51 




260 


13 


5.8 


Regular 


22.40 




727 


36 


30.8 


Special 


1.00 




36 




27.8 


D and D 












Small 


.59 




73 


7 


8.1 


Regular 


7.62 




272 


1^ 


28.0 


Special 


5.50 




198 


10 


27.8 


Title III 


16.70 


1.67 


910 


^6 


18. ^ 


NSF: 












Course Content 












Improvement 


13.50 




607 


30 


22.2 


Teacher Institutes 


38.30 




313 


16 


30.0 



E [P (K.USOE+NSF)] . 



"*'std = Standard deviation of P, „ (K, USOE+NSF) . 

o o 

^Clark and Hopkins, 1968, p. 453. 

^Table B-2. 
3 

Except for Title V and III monies, appropriations are exact. 

U 

Appendix C. 
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Table B-5 

OE 

a,Q(I,K,R), THE DISTRIBUTION OF RESEARCH ACTIVITY 
BY FEDERAL PROGRAMS IN FY 1968^ 



Program^ K 



Research Activity^ R 



Basic and 
Mission- 
Oriented 
Research 

68^ ' 





ic 














Mean 


Std"*" 


Mean 


Std"*" 


Mean 


Std"*" 
















Centers 














DEL 


. 53 


. 06 


• 32 


.06 


. 15 


. 05 


DCVR 




nfi 


If) 


OS 


49 


. 06 


DESR 


.50 


.06 


.34 


.06 


.16 


.05 


HCY 


.50 


.05 


.30 


.05 


.20 


.05 


Policy Study 


1.00 












Instructional Mtrs 


.07 


.05 


.22 


.08 


.71 


.08 


Laboratories 


.07 


.05 


.83 


.06 


.10 


.05 


Clearinghouses 






.05 


.05 


.95 


.05 


Research Coordinating 














Units 


1.00 












State Dept Research 














Divisions 


.47 


.08 


.22 


.07 


.31 


.07 


Research 














Small 


.97 


.01 


.02 


.01 


.01 


.01 


Regular 


.85 


.04 


.11 


.03 


.04 


.02 


Special 


1.00 












D and D 














Small 


.19 


.06 


.70 


.07 


.11 


.05 


Regular 


.27 


.05 


.53 


.05 


.20 


.05 


Special 


.14 


.05 


.68 


.06 


.18 


.05 


Title III 


.28 


.06 


.56 


.06 


.16 


.05 


NSF: 














Course Content Improve- 














ment 






.83 


.05 


.17 


.05 


Teacher Institutes 










1.00 





Development 
Activities 

a°|(i.K.2) 



Innovation 
Activities 

a^^(i.K,3) 



*E[a^^(I,K,R)], 



Std 



-OE, 



Standard deviation of a,o(I,K,R). 

DO 



Mean values were set equal to data in Clark and Hopkins, 1968» 
p. 249. The standard deviations are subjective Judgments of the 
author • 
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OE 

USOE or NSF supported positions; Bgg(I,K) can be written as: 



OE ^68^^^ 
^68^^'^^ " Wgg(K) P^g(K.USOE + NSF) ^^"^^ 



Bgg(K) instead of Bgg(I,K) appears in the numerator of Equation B-5, be- 
cause appropriations data are available only as a function of Federal 

programs, and not institutional setting and Federal program. 

OE 

The further assumption is made in Eq. B-5 that Bgg(I,K) is con- 
stant over all institutional settings for a given Federal program, K. 

OF 

In mathematical language this means that the random variables PgS^'^l*^^ 
and Bgg(l2»^^ equal for all values of and this is a con- 

servative assumption, in that Var[Agg(R)] will be larger than if the 
Bgg(I,K)'s were independent or partially dependent. The possible error 
from this assumption is small since, as Table B-2 shows, most of the 
work in a Federal program is performed in a single institutional setting. 

Substituting Eq. B-5 into Eq. B-A gives the transformation needed to 
convert data on positions into activity in work group (I, R, USOE + NSF). 

Agg(I,R,USOE + NSF) = 
— ^ OF ^fift^^^ 

Z-eS^W^ W^^(K)P,3(K.US0E+NSF) I^eS^^'^'^S^^ + NSF). (B-6) 

The true value of Agg(I,R,USOE + NSF) is estimated by the expected value 
of Aggd.R.USOE + NSF) , and this quantity will also be derived shortly. 

B, (K)E[P,„(I,K,USOE+NSF)] 

E[Agg(I.R.USOE+NSF)] = L ctgg (I .K, R) 



K " W^g(K)E[Pgg(K,USOE+NSF)] 



(B-7) 



The uncertainty in Agg(I,R,USOE + NSF) is estimated by the variance of 
Aggd.R.USOE + NSF), and this quantity will also be derived shortly. 
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Var[Agg(I,R,USOE+NSF)] - {E[Agg (I ,R,USOE+NSF) ] } . 



OF 

Var [ a^g ( I , K , R) ] Var [ g (K) ] Var [W^ g (K) ] 



(5J^(I,K,R))2 iJ(K) W2^(K) 



Var[P,Q(K,USOE+NSF)] Var [P, o(I,K,USOE+NSF) ] 
-H 2° ^ 0° ^ (B-8) 

(E[P^g(K,USOE+NSF)])^ (E [P^g(I ,K,USOE+NSF) ] )^ 



Equations B-7 and B-8 are the models used to generate the results in 
Table B~6, Most of the input data called for in these equations ap- 
pear in Tables B-2 through B-5. Only data for W^s^^^ missing. 

As Table B-A shows, many Federal programs cluster around $30;000 
per position. Having this information, the a priori assumption will 
be made that ^^gW " $30,000, and that the standard deviation of 
W^g(K) is Std[W^g(K)] - $4,500. If knowledge about Wgg(K) is Gamma 
distributed, these assumptions imply that with probability .35 the true 
value of W^g(K) is between $27,250 and $32,250 and with probability .90 
between $21,000 and $39,000. 

Data for a5^(I,K,R) are only available as a function of program, 

K, and research activity, R; thus, the conservative* assumption is 

OE 

made that for a given program, K, the fraction, a^^, of effort in re- 
search activity, R> is the same in each institutional setting (see 
Table B-5). With this assumption the subtotals of performance are, 
after summing Eqtiation B-6 over all institutional settings: 



EtAgg(R,USOE+NSF)l - ESgg(K,R) - 



and 



Var[Agg(R,USOE+NSF)] - 52E[Agg(R,USOE+NSF)]^ • (B-9) 

K 



* 



The assumption is conservative in that the variance of A,n(R, 
USOE+NSF) is greater than if the oigj's were assumed identically distri- 
buted, but independent. The assumption has only a small effect on the 



w-rn^ final answer since, as Table B-2 shows, most of the performers in a 

clyL Federal program work in a single institutional setting. 
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Table B-6 

A (I,R,USOE+NSF)--RESEARCH ACTIVITY IN MAN-YEARS 
SUPPORTED BY FEDERAL PROGRAMS,^ FY 1968 



Research Activity^ R 





Basic and 
Mission- 
Oriented 
Research 
(R-l) 


Development 
Activities 
(R=2) 


Innovat ion 
Activit ies 
(R=3) 


Subtotals 


Mean 


Std"*" 


Mean 


Std"^ 


Mean 


Std"*" 


Mean 


+ 

Std 


Colleges and Universities 




O £, 




7 7 


0 j/ 


0 Q 




1 


Schools and Colleges of 


















Education 


(558) 


(63) 


(358) 


(4'5) 


(243) 


(26) 


(1159) 


(75) 




















of Psychology 


(119) 


(16) 


(39) 


(6) 


(17) 


(3) 


(1758) 


(17) 


Other Behavioral and 


















Social Science Depts 


(185) 


(27) 


(146) 


(21) 


(38) 


(8) 


(368) 


(35) 


Other Discipline and 


















Ar'^Hpm'i r» Afo^c 


(112) 


(15) 


(182) 


(23) 


(46) 


(9) 


(340) 


(30) 


College and University 


















Administration Areas 


(5) 


(1) 


(1) 








(7) 


(1) 


U. S. Office of Education 


















•jk-di-cr i^tr^JLo (jJL JuU liC d L J. (J 11 


















AnH Ot'hPT' ^t";5t"p Aopnpi 
ciiiu w u i 1 ^ 1. OL.ciL.tr f»KtrLi^x.tr3 


79 


12 


30 


8 


53 


9 


162 


18 


Schools and School Systems 


162 


63 


321 


86 


92 


33 


575 


108 


Private Research Institutes 


















and Agencies 


52 


6 


4 


2 


2 


1 


57 


7 


Professional Education 


















Associations 










4 


1 


4 


1 


Other Professional, Public, 


















and Lay Associations 


17 


3 


126 


17 


37 


7 


179 


2 


Interagency Organizations 


















and Education Laboratories 


56 


41 


659 


140 


79 


42 


793 


132 


Business and Industrial 


















Organizations 


















Total 


1344 


139 


1866 


180 


923 


99 


4133 


226 



*E [a, (I,R,USOE+NSF)]. 



Std = Standard deviation of A, ^ (I , R, USOE+NSF) . 

bo 

Eqs. B-7 and B-8. 
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VartAgg(R,USOE+NSF)] ^ Var[agg(K,R) ] ^ Var[Wgg(K)] 



! 



The derivation of Eqs. B~7 and B-9 begins by vnriting the Taylor 
expansion for each term in Eq. B-6. Letting Aj^ be the K^^ term in 
Eq. B-6, the zero and first order Taylor expansion of Aj^ is: 



^ " |»68^^'^'^^ vi68(K)E[P68^^'"S°^+NSF)] j ' 

Wgg(K) - Wgg(K) Pgg(K,USOE+NSF) - E [P^g (K,USOE+NSF) ] 
W68(K) E[Pgg(K,USOE+NSF)l 



Pgg(I,K,USOE+NSF) - E[Pgg(I,K,USOE+NSF)] 



E{Pgg(K,USOE+NSF)] 



The expected value of thlM Taylor expansion is: 



-OK - 

Ogg(I,K,R)Bgg(K)E[Pgg(I,K,US0E+NSF)] 
E[A^] - — — - — ■ 

Wgg(K)E[Pgg(K,USOE+NSF)] 



(B-11) 



(B-12) 



and the variance of this approximation to Aj^is: 

OE, 

I •}( I varif 

Varl ^ I K I I 

%8'"'"'"^^ «^g^r./ *«ggV 



OF 

^ n (a?^(I,K,R))2 bL(K) W?„(K) 



VarlPgg(K,USOE+NSF)] Var [Pgg(I ,K,USOE+NSF) ] J 
(E[Pgg(K,irSOE+NSF)]=' "* ElPgg(I.K,USOE+NSF)] \ ' ^^'^^^ 
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Taking the expected value of Eq* 8-6 and substituting in Eq. B-12 
gives Eq. B-7. Taking the variance of Eq. B-6 and substituting in 
Eq. B-13 gives Eq. B-8. 

USOE AND NSF SUPPORTED PERFORMANCE IN FY 1965 

The models of the \ cevious section could also be used for esti- 
mating performance in FY 1965, except that position data for FY 1965 
are not available. Position data for FY 1966, however, are available 
and ars easily extrapolated back to FT 1965. 

If J (K) is the appropriation level of Federal program K in FY 
1965, and Bgg(K) the same quantity for FY 1966, then it is reasonable 
to assume that the positions supported by a Federal program in FY 1965 
are related to positions supported in FY 1968 by: 

B.,.(K) 

Pg5(I.K,US0E+NSF) « ^HX) ^66^^ * (B-14) 

where Bgj(K) is expressed in FY 1965 dollars. Since few FY 1966 pro- 
grams existed in FY 1965, none were dropped, and none were increased 
by more than a small amount, Eq. B-14 is a reasonable model. It as- 
sumes no significant re-allocations were made in the USOE and NSF 
budgets between FY 1965 and FY 1966 other than to start new programs. 

Using Eq. 4 as a parallel, the research activity supported by 
USOE or NSF in FY 1965 is: 

Ag5(I,R,US0E+NSF) - 21 (I ,K,R)Bg^(I ,K)Pgj(I ,K,USOE+NSF) . 

^ (B~15) 



OE 

Using Eq. B-7 as a parallel, Bg^d.K) is 

OE ^65 
Bgjd.K) - w.^(K)P,^(K,USOE»-NSF) ' ^^'^^^ 



Then since J^Pgs (^'^^'USOE+NSF) = P^^ (K,USOE+NSF) , the research 



-76 



activity supp:>rted by TJSOE or NSF is 

_ _ B,^(K)P.,(I,K,USOE+NSF 
A,3(I.R.US0E+NSF) - Ea°^(I.K.R) (k)P,,(K.USOE^NSF) * 

(B-17) 

Tliis equation was obtained by substituting Equations B-IA and B-16 into 
Equation B-15. 

The expected value of A^^ (I .R.USOE+NSF) is, 

L^(K) E[P,,(I,K,USOE+NSF)] 
EIA,3(1.R.US0E+NSF)] - Ea^^d.K.R) • e[P,,(K.USOE^NSF) 1 



(B-18) 



and the variance of A^^ (I ,R,USOE+NSF) is, 



Var[Ag3(I,R,US0E-iT;SF)] - |e • A^^ (I ,R,USOE+NSF) ]p . 
OF 

I Var[ag5(I,K,R)] Var[B^5(K)] Var[Wg5(K)3 

I (ag5(I,K,R))2 b2j(K) w2^(K) 

Var[P^g(I,K,USOE+NSF)] Var[Pgg(K,USOE+NSF) ] | 
(E[Pgg(I,K,USOE+NSF)])^ (E[Pgg (K,USOE+NSF) ] ) j 



(B-19) 



The estimates of FY 1965 USOE or NSF supported research activity 
appearing In Table B-7 were calculated from Eqs. B-18 aud B-19. 

Some of the Input data required by Eqs. B-18 and B'-19 appears in 
Tables B-3, B-8, and B-9. In addition it was assumed that Wgj(K) - 
$25,800, which Is Wgg(K) deflated by 5 percent per year. As for FY 
1968, it was assumed that Std. Wgj(K)l - .15 Wgj(K). 
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Table B-7 

A (I,R,USOE+NSF)--RESEARCH ACTIVITY IN MAN-YEARS 
SUPPORTED BY FEDERAL PROGRAMS, FY 1965^ 





Research Activity, R 




Basic and 
Mission- 
Oriented 
Research 

(R=l) 


Development 
Activities 
(R=2) 


Innovation 
Activities 
(R=3) 


Subtotals 


Setting, I 


* 

Mean 


Std"*" 


* 

Mean 


Std"*" 


* 

Mean 


Std"*" 


* 

Mean 


Std^ 


Colleges and Universities 
Schools and Colleges or 

Education 
Schools and Depts of 

Psychology 
Other Behavioral and 

Social Science Depts 
Other Discipline and 

Academic Areas 
College and University 

Administration Areas 


1095 
(521) 
(174) 
(248) 
(143) 
(9) 


161 
(93) 
(30) 
(77) 
(28) 

(2) 


362 
(136) 
(36) 
(34) 
(155) 
(1) 


103 
(50) 
(17) 
(29) 
(29) 
(1) 


486 
(61) 
(8) 
(9) 
(33) 


85 
(17) 
(5) 
(9) 
(11) 


1943 
(717) 
(217) 
(291) 
(331) 
(10) 


215 
(88) 
(28) 
(76) 
(38) 
(2) 


U.S. Office of Education 


















State Depts of Education 
and Other State Agencies 


91 


12 


4 


3 


1.0 


1.0 


96 


12 


Schools and School Systems 


4 


1 


1 








4 


1 


Privatp Rp^parch Insti- 
CuCes and Agencies 


53 


11 


7 


6 


2 


2 


62 


10 


Professional Education 
Associations 


















Other Professional, Public, 
and Lay Associations 


4 


1 


107 


2 


22 


7 


132 


21 


Interagency Organizations 
and Education Labs 


















Business and Industrial 
Organizati ons 


















Total 


1248 


202 


481 


131 


510 


94 


2237 


207 



E [a (I,R,USOE+NSF)]. 



^Std = Standard deviation of A^^d.R, USOE + NSF) . 
■''Eq. B-13. 



ERIC 
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Table fi-8 

a^^(I,K,R)--THE DISTRIBUTION OF RESEARCH ACTIVITY BY 
FEDERAL PROGRAM, FY 1965^ 







Research Activity, 


R 




Basic and 
Mission- 
Oriented 
ReRcarch 


Development 
Activities 


Innovation 
Activities 

a^3(i.K,3) 


Mean 


Std"^ 


Mean 


Std 


Mean 


Std 


USOE: 














Centers 














DEL 


. 53 


. 06 


. 32 


. Oo 




. 0^ 


DCVR 


.33 


.08 


. 18 


. 07 




no 


DESR 














HCY 














Policy Study 














Instructional 














Materials 














Laboratories 














Clearinghouses 














Research Coordinating 














Units 


1.00 












State Dept Research 














Divisions 














Research 














Snuill 


.97 


.03 


.03 


.03 






ive^u 1 aL 


.85 


.10 


.12 


.10 


.03 


.05 


Special 














D and D 














Small 














Regular 














Special 














Titlrt III 














NSF: 














Course Content Improve* 














ment 






.83 


.05 


.17 


.05 


Teacher Institutes 










1.00 





*E[a^^(I,K,R)]. 



std « Standard deviation of a..(ItK,R). 

^Mean Values were set equal to data in Clark and Hopkins, 1968 » 
p. 249. The standard deviations are subjective Judgments of the 
author. 
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Table B-9 

Bg5(K) —APPROPRIATIONS IN FEDEmLY SUPPORTED PROGRAMS, FY 1965 



Program, K 


FY 1966 
propria Lions 
($ millions) 


FY 1 96*5 
Appropriations^ 

ill X XX XL'ilo / 


Average 
Cost per 
Position 
FY 1966^ 




Mean Std"*""^ 


($ thousands) 


USOE: 








Centers 








DEL 


6. 79 


2 17 11 




DCVR 


1. 00 




25.6 


DESR 


1. 70 




JO. 3 


HCY 


.47 




^ J. 0 


Policy Study 


1 00 




32. 0 


Instructional 






Ma t* r 1 1 Q 


1 • UU 




1A.7 


Laboratories 


8.03 






Clearinghouses 


1.5A 






Research Coordi- 






nating Units 


2.15 


2.18 .11 


9.4 


State DepartDpnt Re- 














7.8 


Research 






Small 


1. 67 


2 40 19 


J.J 


Regular 


22.80 


30.60 1.53 


27.9 


Special 


1.00 




27.7 


D and D 






Small 


.65 • 




7.2 


Regular 


13. AO 




25.6 


Special 


5.50 




27.7 


Title III 


6.00 




12.5 


NSF: 








Course Content 








Improvement 


10.39 


9.28 .A6 


20,2 


Teacher Institutes 




9.70 





*E[P.^(I,K,USOE+NSF) ]. 



STD » Standard Deviation P, ^ (I .K,USOE+NSF) . 

1 

Clark and Hopkins, 1968, Table 55, Col. 1. 

2 

U,S, Office of Education^ 1969 (in order of entry) pp, 116^ 79» 78» 
80, 78; reported by Bureau of Handicapped, USOE, pp. 116, 91, 79, ESEA 
Title V not authorized In FY 1965; total USOE research budget on p. 128, 
minus amounts already Included above, split In same proportions as FY 
1966 except "special" projects which did not exist; did not exist prior 
to ESEA passage FY 1966; reported by Precollege Division, NSF (see Ap- 
pendix C/. 
3 

Assign a standard deviation of 5 percent of mean. 
Q See Table B-3 for positions data needed to calculate average cost. 

ERIC 
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Appendix C 
NSF TEACHER INSTITUTE PROGRAMS 

The data on NSF teacher institute programs called for in previous 
appendices is developed in this appendix. The form of the model needed 
to do this is tailored to the format of relevant NSF data. 

The key items of NSF data are the appropriations for teacher in- 
stitutes and the portion of each appropriation devoted to staff salaries. 
(The remaining cost of these programs ±3 incurred as participant stipends, 
dependency allowances, and participant travel allowances.) Knowing the 
fraction spent on staff salaries, and assuming an average cost of roughly 
$30,000 per man-year of professional effort, the total professional man- 
years is simply the ratio of staff appropriations to man-year cost. 

In mathematical terms, the total man-years of professional effort 
in teacher institute programs is 

^68 ■ ^ ifi (^-^^ 

TI 

where B,j.(K) is the annual appropriation for teacher institute program 
TI 

K, 0^j.(K) is the fraction of program K spent on staff salaries, and 

TI TI 
Wgg is the staff cost per professional man-year. Again W^g is assumed 

to be the same for all programs. The index K stands for one of two 

programs; NSF pre-college teacher institutes (K-1) , or NSF teacher 

college institutes (K-2) . 

NSF data fix the values of 0gg(K) and Bgg(K), thus W^g is the 

only uncertain quantity in Eq. C-1. Expanding Eq. C-1 in a Taylor 

series and proceeding as in Appendix B, it can be derived that 



mil] - 2. (^-2) 



-Bl- 



and 

-TI,„^ ) ,..TI. 



^-I^8l-|5 TtI 1 ^2— (^-^> 

y ^ ^68 ' 68 



- -TI 

The Input data for O^qW and B^g(K) appear In Table C-1. It was as- 
sumed that W^g = $30,000 per man-year, and that Std [W^g] "= .15 W^g as 

XI 

in Appendix B. The resulting estimates of A^g are shown at the bottom 
of Table C-1. 

Since the purpose of NSF teacher Institutes Is to encourage the 
adoption of new science curricula, and not to develop new curriculum 
materials or do research, all man-years of effort and appropriations 
are assigned to the Innovation category of research activity. 
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Table C-1 
NSF TEACHER INSTITUTE PROGRAMS 





FY 1968 


FY 1965 




Pre- 
collego 
(K-l) 


College 
(K-2) 


Pre- 
college 
(K=l) 


College 
(K=2) 


Appropriations for Teacher 
Institutes ($ millions) 


34.2' 


A.l2 


3 

35.3-' 


3.9^ 


Fraction of Appropriation :>pcnt 

on btaii (9 Tnillions^ 

TI 
B (K) 


.23^ 




.235 




Amount Spent on Staff ($ millions) 


7,8 


1.6 


8.1 


1.6 


Cost per Man Year^ ($ thousands) 

r,Ti 

W 


30,000 
30,000 


30,000 
30,000 


25,900 
25,900 


25,900 
25,900 


Standard Deviation Cost per Man 
Year^ ($ thousands) 










std[v,"] 


4,500 


4,500 


3,900 


3,900 


Expected Man-years in TI Programs 












313 


375 


Standard Deviation of Mar^^years 
in TI Programs, StdjA'^^J 


47 


56 


Total Appropriations for TI 
Programs ($ millions) 


38. 


3 


39.4 



National Science Foundation, 1969-1, p. 178. 

^Ibid., p. 162. 
3 

National Science Foundation, 1967, p. 97. 

^Ibid., p. 113. 

^U. S, Senate, 1969, p. 424. 

^Ibid., p. 457. 
7 

Author's Judgment. 
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Appendix D 
SPONSORSHIP OF EDUCATION RD&I IN FY 1968 

The methods of Appendix A will also be used to describe the con- 
struction of tables for dollars spent in support of education RD&I. 
The basic model form is familiar by now; if B>.q(S,K) is the total ap- 
propriation spent by agency S on program K, and X^g(S,K,R) is the frac- 
tion spent on research activity R, then the amount spent on research 
activity R by agency S is the sum over all programs of X,q(S,K,R) times 

Do 

B^gCS.K). 

B^g(S,R) = EX58(S,K,R)B^g(S,K) (D-1) 
K 

Sufficient data are available to make reasonably certain estimates of 
X^g(S,K,R) and B^g(S,K). 

As an estimate of the true value of B-o(S,R), the expected value 
is adopted: 

^68^^'^^ =2ZX58(S,K,R)B^g(S,K). (D-2) 
K 

The uncertainty in Bgg(S,R) is estiujated by calculating its variance: 

Var[B^g(S.R)] = 

]^lx^g^(S,K,R)Var[B^g(S,K)]+ B^g^ (S,K) Var [ X^g(S,K,R)] j . (D-3) 



The results obtained from the models "written in Eqs. D-2 and D-3 appear in 
Table 10. The input data for these equations can be found in Table D-1. 



Table D-1 



APPROPRIATION TO AGENCIES FOR EDUCATION RD&I AND ITS 
DISTRIBirriON TO RESEARCH ACTIVITIES, FY 1968 



ft L (JKL am ^ 


Basic and 
Mission- 
Oriented 
Research 
X,3(S.K.l) 


Development 

Activities 

XgQ(S,K,2) 


Innnvation 
Activities 
X,3(S.K.3) 


FY 1968 
Appro- 
priation 
B68(S,K) 
(millions) 


Mean 


Scd 


Mean 


Std 


Mean 


Std 


Mean 


Std 


1 

USOE: (S-1) 


















Centers 


















DEL 




• 20 


. 3/ 


9n 
. /O 


. 1 J 




ft in 

O . lU 




DCVR 


. 33 


• II 


1 Q 


. 10 


A Q 


1 9 


9 97 




DESR 


• 50 


.20 


. 3h 


. 20 


. 10 


. iH 


1 . /U 




HCY 


cn 
• jU 


• 21 


. 30 


on 
. ^0 


9n 


1 7 
.1/ 






Policy Study 


1 • uu 












1 no 




Instructional Materials 


• u/ 


• 0/ 


99 


1 c 

. I J 


7 1 

. / 1 




9 7 ^ 




Laboratories 


• U/ 


• 07 


.83 


1 9 


1 n 

. 10 


1 n 
. lU 


9 7 ftfl 




Clearinghouses 








. \}j 


Q ^ 


. \Jj 


0 17 




Research Coordinating 


















Unito 


1 • UU 












1 nn 

1 • UU 




State Department Research 


















Divisions 


.47 


.21 


.22 


.17 


.31 


.20 


2.52 


.25 


Research Projects 


















Sm^ll 


.97 


.02 


.02 


.02 


.01 


.01 


1.51 




Regular 


.85 


.06 


.11 


.05 


.04 


.04 


22.40 




Special 


1.00 












1.00 




D and D Projects 


















Small 


.19 


.10 


.70 


.10 


.11 


.07 


.59 




Rpanla f 


.Zi 




. !> J 


1 1 
.11 


9n 


no 


7 AO 
/ . OZ 




opeciai 




no 


• no 


1 1 
. 11 


. lo 


. lU 


^ ^n 

J . JU 




Ti t- 1 o TT T 

1 1 c 1 e 11 1 




1 n 




1 1 
. 11 


. 10 


. UO 


1 A 7n 

1 o • / u 


1 ft! 


1 n c r amur a i 


.85 


.11 


.10 


.10 


.05 


.07 


3.00 


1.00 


NSF: (S«2) 


















v^ouLse v^once'*c iiupiove~ 


















men t 


















ft L ecciie^e 






. o3 


1 n 
. 10 


. 1/ 


1 n 

. 10 


1 1 ^n 




College3 






. o3 


1 n 
. lU 


1 7 
.1/ 


1 n 
. lU 


A nn 

0 . UU 




Teacher Institutes^ 










1.00 




38.30 






















neaa btarc 


.30 


.24 


.40 


.26 


.30 


.24 


5.90 




jfoilov I'tirougn 


.27 


.20 


.45 


.24 


.28 


.20 


2.20 




Ouuiiu n 1 u y Accion ftLo^Lam 


.50 


.28 






.40 


.28 


4.70 




Other Federal 


















Agencies:^ (S«4) 


















NIMH 


.86 


.03 


.09 


.02 


.05 


.02 


14.10 


10.00 


NICHD 


.91 


.05 


.09 


.05 






10.00 


6.00 


DOD 


.67 


.05 


.33 


.05 






8.00 


6.00 


Other 


.62 


.06 


.32 


.05 


.06 


.02 


7.00 


5.00 


St&te Government:^ (S»5) 


.33 


.24 


.33 


.24 


.33 


.24 


3.00 


3.00 


Foundations and 


















Other :Q (S-6) 


.76 


.06 


.21 


.05 


.03 


.03 


14.00 


10.00 


9 

Industry: (S-7) 


.40 


.15 


.50 


.15 


.10 


.10 


7.50 


7.50 



ERIC 
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NOTES TO TABLE D-1 



1. The mean values for ^go(S,K,R) were set equal to the data in Clark 
and Hopkins, 1968, p. 249. (See also Table B-5.) The standard de- 
viations of ^^g(^»^»^) were assigned somewhat larger than in Table 
B-5. since the Clark and Hopkins data are for positions, not appro- 
priations. See Table B-4 for appropriations data. 

2. See Tables A-1, A-2, A-4 and A- 5. Assume that USOE expenditure is 
roughly $30,000 per professional man-year. 

3. U. S. Senate, p. 445. 

4. Appendix C. 

5. U. S. Office of Education, 1969, p. 116. Following the definitions 
in this study, evaluation money is classed as development* Complete 
ignorance of the division of research and demonstration monies into 
research and innovation categories was assumed* 

6. U. S. Office of Education, 1969, p. 129* Research training monies 
are not included* Evaluation and achievement studies are included 
as rp^e^irch* Demonstrations are included in innovation. All appro- 
ve- i^'tci:^s are increased 20 percent to account for non- respondents 
(Ibid, p. 117)* 

7* In Phillips, 1967, p* 76; total state agency expenditures for R&D were 
roughly $3.1 million in CY 1965 (Dimensions III and IV). Assuming 
half of this expenditure is financed by the state (National Science 
Foundation, 1967-2, p* 7), roughly $1.5 million of R&D activity was 
sponsored at the state level in 1965. The same NSF source, p. 31, 
reports $5.9 million was spent (or sponsored) by states in 1965. 
The chart entries for FY 1968 are based on these pieces of informa- 
tion. It is assumed that addition of ESEA Title V did not increase 
state support for R&D* 

8* U* S* Office of Education, 1969, p. 129, As compensation for non- 
respondence, increase the value on p* 129 by 20 percent (Ibid, p* 
117). 
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Appendix E 



PERFORMANCE AND SPONSORSHIP OF AGRICULTURE RD&I, FY 1968 

In agriculture, non-industrial RD&I performance and sponsorship in 
FY 1968 can be readily obtained from data published by the U. S. Depart- 
ment of Agriculture without the elaborate transformational steps required 
In education. Industrial RD&I performance and sponsorship can be esti- 
mated by extrapolating data published in FY 1966 to FY 1968, as was done 
for nonfederal evducation performance in Appendix B. 

The format of the agriculture data is different from education 
or health in that, as part of a continuing program budgeting effort, 
USDA reports agricultural RficD activity in a hierarchical goal structure 
format. USDA has established up to 15 subgoals within each of 9 
goals and reports R6cD activity in each of these categories and subcate- 
gories. Few of these goals and subgoals can be translated into solely 
a research or solely a development activity, nor does USDA break down 
activity within goals or subgoals into RD&I classes. Consequently, 
subjective estimates must be made to get USDA data into the format of 
this study. These estimates have been based on worded descriptions of 
the activity in each goal. 

The model used for transforming man-years of performance data in 
nonindustrial settings to the desired format is: 



where /i^g(I,G) is man-years of performance in institutional setting, I, 
and subgoal, G, and k(I,G,R) is the fraction of total man-years spent 
on research activity, R. As in Appendix A, independence between the k's 
and the A^g*s is assumed^ The true value of A^gCl^R) is estimated by 
the expected value: 




(E-1) 




(E-2) 
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The uncertainty in A,-(I,R) is estimated by the variance: 



Var[Agg(I,R)] = 




(I,G,R)Var[A^g(I,G)] + E [^^s (^»G>] ^^^^ ["^eS ^^'^^ ( 



(E-3) 



Input data for the models written as Eqs. 2 and 3 appear in Table E-1. 
The results of these models appear in Table 4. 

The data for ic^g(I,G,R) were assigned by examining a USDA list of 
project areas in each goal. If 20 out of 30 project areas in a goal 
were classed as research, then K^g(I,G,R) = .66 was assigned, etc. In 
making these assignments, the definitions in Table 2 were utilized. 
Since the level of effort in each project area was not quoted in the 
USDA list a high value was assigned for the standard deviation of 
<68(I,G,R). 

As mentioned in the first paragraph, activity data for the indus- 
trial setting (I « 4) have been published by USDA for FY 1965, but not 

Ae 

for FY 1968. Letting / ^(G) be the growth factor of industrial R&D in 
goal G between FY 1965 and FY 1968, A (4,G) can be written as: 



where A,-(4,G) is the man-years of performance in FY 1965. As in Appen- 

Ae 

dix A, make the conservative assumption that y (G) is the same in each 
goal, then, 



A_(4,G) =y''2(G)A_(4,G) 



(E-4) 



E[Agg(4,R)l] = y^^Kgg(4,G,R)E[Ag3(4,G)] 



(E-5) 



and 
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In calculating results from Eqs. 5 and 6, assume/ =1, which means 
that industrial R£cD is estimated not to have grown at all between FY 1965 
and FY 1968. From Table 16 in Chapter 5, it is apparent that federally 
sponsored performance changed very little from FY 1965 to FY 1968. This 
result is assumed to carry over into industrial R&D. Recognizing the 
maturity of agricultural R&D, this assumption seems reasonable. 

Since estimates of the G,R)s were based on an aggregate of 

Do 

data for USDA and SAES, the degree of correlation between the one for 

USDA (►^gg(l>G,R)) , and for SAES (K^g(2,G,R)) will be high. As a 

conservative measure assume perfect correlation. Then, 

E[Agg(R)] = Eji^es^^'^'^^S^^^'^^ ^68^^'^'^^^^^*^^1 

G 1=1 

and 



Var[Ag3(R)] = 



2 2 
X;jK68^^'^'^^?^"[^^^'^^] ^ Var[Kgg(l,6,R)](^E[A(I,6)])2 + 
G I ~ 1 1=1 



-2 

•^68 



(4,6,R)Var[Agg(4,6)] + Var[Kgg(4,6,R)] ' E[A(4,6)]^f . (8) 



The results obtained from these equations appear in Table 4. 

Substituting B^g(S,6) for Agg(I,6), and >gg(S ,6 ,R) f or Kgg(I,G,R), 
these same equations apply also for agriculture sponsorship. Input data 
and results for agriculture sponsorship appear in Table E-2, and in 
Table 9. 



-89- 



Table E-1 

INPUT DATA AND RESULTS FOR RD&I PERFORMANCE, FY 1968 





Fraction of 










Effort in 


Man- Years 


Man-Years in 




Research 


■ of Effort 


Research 


Institutional Setting 


Kggd.G.D^ 


Aggd.G) 


Aggd,ii=i)^ 


I and Goal G 


Mean 


Std 


Mean 


Std 


Mean 


Std 


•1 

USDA (1=1) 






4 HQ 4 


300 


2085.0 


356.8 


G=l 




. 20 


800. 3 








G=2 




. 20 


1,028.6 








G=3 




20 


621 S 








G=4 


40 




Q77 1 








G=5 


.76 


.15 


322.2 








G=6 


.77 


.15 


75.8 








G=7 


.59 


.20 


180.3 








G=8 


.67 


.20 


139.5 








G=9 


. 54 


.20 


174.0 


















1 


Unlversltles2 (1=2) 






9,551.0 


50 


2359.8 


525.7 


G=l 


.55 


.20 


541.4 








G=2 


.44 


.20 


1197.3 








G=3 


.33 


.20 


2155.6 








G=4 


.40 


.20 


506.4 








G=5 


.76 


. 15 


227.3 








G=6 


.77 


.35 


19.4 








G=7 


.59 


.20 


190.6 








G=8 


.67 


.20 


122.8 








G=9 


.54 


.20 


442.0 








Ag Extension-' 






4000 


50 






County Agencies^ 














(1=3) 














Ag Extension 






11,000 


275 






Industry-^ (1=4) 






15,900 


1564 


7950.0 


2359.0 


G=l 


.50 


.28 


600 


120 






. G=2 


.50 


.28 


4,000 


800 






G=3 


.50 


.28 


4,000 


800 






G=4 


.50 


.28 


5,250 


1050 






G=5 


.50 


.28 


700 


140 






G=6 


.50 


.28 


250 


50 






G=7 


.50 


.28 


800 


160 






G=8 


.50 


.28 


100 


20 






G=9 


.50 


.28 


200 


40 






Total 






40,620 


1590 


12,396.0 


2443.1 



U.S. Department of Agriculture, 1969, Table III-D-8, 



Ibid. , Table IV-C-9. 

3 

Data reported by USDA in private conversation. Assume all man- 
years are innovation. 
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Data reported by USDA in private conversation. 

^Equation E-4 and U.S. Department of Agriculture, 1966, p. 8. Data 
based on SIE survey. Assume no knowledge of the split between research 
and development. 

6 

The man-years data in the above sources are for R&D only. Thus 
Kgg(I,G,3) =0. 

^Equations E-8 and E-9. 
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Table E-2 

INPUT DATA AND RESULTS FOR AGRICULTURE RD&I SPONSORSHIP, FY 1968 













Fraction of 




Fraction of 1 


Total 


Research 




Sponsorship 


Sponsorship^ 


Sponsorship- 




in Research-'- 


($ millions) 


($ millions) 


Sponsor S and 




Bg8(S.6) 


Bg8(S,R=l) 


Goal G 


Mean 


Std 


Mean 


Std 


Mean 


Std 


USDA (S=l) 






303.2 


0 


97.8 


17.7 


G=l 


.55 


.20 


33.3 








G=2 


.44 


.20 


54.7 








G=3 


.33 


.20 


43.6 








G=4 


.40 


.20 


39.8 








G=5 


.76 


.15 


12.6 








G=6 


.77 


.15 


1.7 








G=7 


.59 


.20 


10.3 








G=8 


.67 


.20 


5.0 








G=9 


.54 


.20 


9.1 








Ag Extension 






93.5 








State Government 






121.8 


0 


50.8 


13.0 


G=l 


. 55 


.20 


10.8 








G=2 


.44 


.20 


28.5 








G=3 


. 33 


.20 


55.6 








G=4 


.40 


. 20 


10.8 








G=5 


,76 


.15 


2^4 








G=6 


.77 


.15 


.3 








G=7 


.59 


.20 


2.9 








G=8 


.67 


.20 


2.0 








G=9 


.54 


.20 


8.5 








Ag Extension 






147.5 








Industry 






460.0 


45.1 


230.0 


69.3 


G=l 


.5 


.28 


17.0 


3.4 






G=2 


.5 


.28 


115.0 


22.0 






G=3 


.5 


.28 


115.0 


22.0 






G=4 


.5 


.28 


160.0 


32.0 






G=5 


.5 


.28 


15.0 


3.0 






G=6 


.5 


.28 


8.0 


1.6 






G=7 


.5 


.28 


22.5 


4.5 






G=8 


.5 


.28 


1.5 


.3 






G=9 


.5 


.28 


6.0 


1.2 






Total 






1032.5 


45.1 


. 378.6 


72.7 



Assume same values as for k, (I,G,1) in Table E-1. 



U. S. Department of Agriculture, 1967, Tables III-D-8 and IV-C-9. 
Ibid,, 1966, p. 56 for industry. 
3 

Equations E-7 and E-8. 
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Appendix F J 
PERFORMANCE AND SPONSORSHIP OF HEALTH RD&I, FY 1968 

RD6cI performance and sponsorship in health can be obtained from 
data that have been collected by the Office of Resource Analysis at NIH. 
These data are not divided into research and developraent classes, but 
sufficient auxiliary information is available to divide the sponsorship 
data into these two classes. Information which would enable the same 
division on the performance side is not available. 

For performance, the NIH data give dollars spent by sponsor S, and 
the distribution of these funds by performing institutions. Therefore, 
the dollars consumed in an institutional setting can be found by summing 
the portion of funds contributed to an institutional setting over all 
sponsors. The total man-years of effort can then be found by dividing 
by the cost per man-year. 

In mathematical terms, the man-years of effort in institutional 
setting I is related to dollars of sponsorship by 

where B,q(S) is the dollars contributed by sponsor S and /)(I,S) is the 
oo 

fraction consumed in institutional setting I. The rate W,o(I) is the 

DO 

cost of RD&I activity per man-year in institutional setting, I. 

Considering all quantitites in Eq. F-1 as uncertain, the estimates 
of performance are: 

4^8(^>] =(^68(^>)"'?^8(^'^>^h8^S>] <^-2) 

and, 
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Input data for these equations appear in Table F-1. None of the spon- 
sor's money in Table F-1 was spent on innovation activities; thus, the 
resulting estimates are for R&D. activity only. No attempt was made to 
es,timate performance in innovation activities, although some surely 
exists in the health field. 

The NIH data can be used directly to estimate sponsorship. In 
addition, auxiliary data sources can be used to estimate the breakdown 
of the sponsorship totals into money for development and for research. 

The models for estimating the dollars spent by sponsor S for acti- 
vity R are: 

e[b,3(S,R)] =^^3(S,R)E[Bgg(S)], (F-4) 

and 

Var[Bgg(S,R)] = f^^ (S,R)Var [B^g (S)] + Var [Tg3(S,R)] E[Bg3 (S)] ^ . (F-5) 

The input data for these models appear in Table F-2« 

The estimates of ^53(2, R) in Table F-2 are based on NIH and NSF 
information. For the drug industry and all agencies except one, the 
sum of monies each spent on basic and applied research in health-related 
fields of science (which has been tallied by NSF) is less than the total 
health-related R&D (which has been tabulated by NIH). Thus, it would be 
natural to estimate expenditures for development as the difference 
between these numbers. On the basis of discussion with NIH analysts, 
however, apparently some of the applied research would be classed as de- 
velopment under the definitions adopted here. Consequently, estimates 

of T (S,R) were assigned for government agencies in the following ways. 
60 

All of the basic research plus one-half of the applied research was ex- 
pressed as a fraction of the total health-related R&D. The result was 
assigned as t(S,R). The estimate of Std T^g(S,R) was set equal to one- 
fourth of the applied research expressed as a fraction of total R&D. 
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Table F-2 



INPUT DATA FOR SPONSORING HEALTH R&D, FY 1968 





Fraction of 
Sponsor ' s 
Dollars Spent 
on Research 


^68 
of Dollars 
Sponsorship^ 
(millions) 


B,g(S,R=l) 

Dollars Spent 
on Research 
(millions) 


Sponsor, S 


Mean 




"M a a r*i 


Std 


Me an 


Std 


NIH^ 


70 


15 






fiOS 0 


130. 0 


Other DHEW 

Consumer Protection 

HSMA 

Other 


.43 


. 11 


264.0 
(78.3) 
(146.7) 
(39-3) 




113.5 
(36.0)3 
(68.4)3 
(9.4)3 


29.0 


Vet . Administration 

DOD 

AEC 

NASA 

NSF 

Dept. Commerce 

Dept. Interior 

Dept. State 

Dept. Transportation 

TVA 


c c 

.67 
.78 
.84 
1.00 
.5 
.5 
.5 
.15 
.40 


. Z'J 
.19 
.03 
.06 

.28 
.28 
.28 
.15 
.20 


H-D . 0 

114.0 
95.0 
109.0 
21.0 
1.0 
3.0 
3.0 
5.0 
2.0 




9 ^ 1 3 

76.43 
74. l3 
91.63 
21.0 
.5 
1.5 
1.5 
.83 
.83 


Q n 

21.7 
2.9 
5.4 

.3 
.8 
.8 
.8 
.4 


State (Local) 


.50 


.28 


69.0 


6.9 


34.5 


19.6 


Industry 


.38 


.11 


615.0 


61.0 


233.7 


71.5 


Foundation and Insti- 
tutional Funds^ 


.90 


.10 


185.0 


19.0 


166.5 


25.2 


Total 






2395.6 


65.5 


1446.2 


156.1 



National Institutes of Health, 1969, p. 9. See also, last para- 
graph of Appendix F. 
2 

U. S. House of Representatives, 1971, pp. 43-44. 

3 

National Science Foundation, 1969-2. To get Bgg(S,R=l) add data 
from p. 170 (Biological Aspects and Psychological Sciences), and p. 173 
(Life Sciences), plus one-half of data on p. 195 (Biological Aspects 
and Psychological Sciences) and p. 198 (Life Sciences). 
4 

National Science Foundation, 1969-4, p. 64, for information on 

•^68(^'l>- 

Author's judgment. 
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